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ABSTRACT 


Using the present limited knowledge of nervous tissue of living organisms 


as a guide, an attempt is made to construct an adaptive automaton whese internal 
structure has a Similarity to living nervous tissue. 

Accepting the general contention that living organisms have qualities 
which shuw adaptation and self-o-ganization as illustrated by -.olution and 
the individual organism's . lit to self-reproduce, the existence of these 
organisms is teken as a proof that adaptive systems are possible. Thus the 
philosophy and operation of a general "biological computer" is described, the 
internal comporents of this "computer"! having functional Operation very similar 
to that of a biological neuron--a basic component in nervous tissue, 

After describing this general actomaton, complete functional Specifications 
of the individual elementary components are ideally established. Using these 
specifications of so-called "artificial neurons", an attempt to reduce the 
automaton to practice by che use of electronic techniques is made. In this 
reduction the elementary components are considered as highly versatile infor- 


mation processors, the result being an electronic model of an information 


system having some of the structural and functional characteristics of nervous 


tissue. 


Several of these electronic elementary components have been constructed. 
Experimental tests on these components essentially corroborate the similarity 
desired between them and the biological neurons, 

Initial tests on simple circuits containing these components indicate that 
interesting adaptive behavior is indeed possible with very smail numbers of 


these components. For example, simple adaptive pattern recognizers, order 


detectors, counters, etc, have been constructed, Even some autonomous pattern 
behavior has been detected, These basic processes of adaptation are presently 
of only the most elementary type, but with greater environmental complexity, 
which involves more elaborate input transducers, it is felt that much greater 
adaptive functional behavior is possible, 

Certain unpredicted effects have arisen, For example, normally inactive 
portions of the automaton which are connected to the active yortions only 
through the energy supply occasionally become active pulse-wise in synchronism 
with the autonomous components. This effect has a co~respondence in the 
biological system where the alpha rhythm is present in the inactive cortex, 

In short, a form of "biological computer" is now available which is 
extremely flexible in its operation and potential connectivities, When used 
as a standard analogue device it is useful for detail examination of the 
system functioning, When used in a manner similar to how a biologist examines 
a living operational system, the automaton may be used as a predictive device, 
This latter method is the manner in which the automaton was intended to be 
used and it is hoped that by this method knowledge of various systems will be 


gained and eventually used to construct more elaborate systems, 
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l. INTRODUCTION 


The following pages describe an attempt to construct an adaptive automaton 
whose internal structural features are believed to be modeled according to our 
presert limited knowledge cof biological nervous tissue. 

It is generally accepted .nat the most conspicuous qualities of living 
organisms are their capabliities of adaptation and self~organization, For 
example, evolution and self-reproduction are usually cited as illustrative of 
these qualities, According to the Pioneering work done in the first half of 
this century by Claude Bernard, Norbert Wiener, Warren McCulloch, anu others, 
there seems to oe no doubt today that these qualities can be achievec only by 
the use of a feedback loop consisting of the information flowing from the 
environment through the system and then back into the environment, where the 
system can then take cognizance of its state in the environment due to its 
own activity. We know at present that living organisms possess two major 
systems for internally processing this information, these being the endocrine 
system and the nervous system. 

The work presented here will concentrate on some functional aspects of 
the nervous system only, since its structure seems more amenable to synthe- 
sizing its components by electrical circuits, 

fiace the basic component of nervous tissue is a separable entity, the 
n-uron, the problem at present is that of the constructior of a suitable model 
of a biological neuron and associated system, Since the nerve cells of the 
cortex are essentially all alike or very similar to each Other, a: lesst in 


appearance, the individual functional properties of neurons or af groups of 


2 
neurons are not identifiable by their appearance or by their interconnectivity 
to each other, Therefore the model cannot be Simply an analogue device in the 
usual connotation, It must be flexible enough in its operation to be used in 
its entirety or in sections, as part of a system or as the total System, as a 
control section or as a transmission section, as an input section cr an output 
section; that is, it should nave as many of the attributes of the biological 
rervous system as it is feasible to anticipate, plus attributes which will 
allow it tc be used as a rredictive model of general neuror activity. There- 
fore the model will be a"biological computer" not only in the general meaning 
of an analogue of a natural biological system but also in the much broader 
sense, 

The purpose then of this thesis is to describe in rather general terms 
the philosophy and operation of such a model and to describe in detail, speci- 
fications of the various components, The circuitry of a special electrical 
automaton which is a special case of the general model will be illustrated and 
finally, some simple experimental results obtained with this very limited 


automaton will be presented, 


2. NEUROLOGICAL SUMMARY 


Yo solve the problem posed in Chapter 1l--that ic, the construction of an 
adaptive system which shows some of the behavior characteristics of a biolog- 
ical system--.t is certainly necessary to obtain as much information about 
that biological system as is deemed pertinent, fhis chipter will discuss the 
parts of the nervous system and the data about it which will be used in later 
sections to develop the final solution which, it is hoped, does indeed have 
Similar characteristics, Since the present system is to be constructed with 
electronic and associated parts, the emphasis in the following discussion will 
be on the electrical effects and in general the electrophysiology of the 
nervous system, That is, even though the functioning of the various components 
of any nervous system is primarily chemical in nature, oniy that part of the 
chemistry which seens necessary to explain superficially the electrical effects 
which resuit will be discussed, 

The basic doctrine of nervous functioning asserts that the nerve cell and 
its associated appendages--together called the neuron--is the basic unit of the 
nervous system and is directly involved in all nervous functioning and that all 
nerve fibers which transmit information are merely anatcmical extensions of the 
neuen: Therefore, the neuron is most fundamental in a discussion of any 
biological nervous system, 

Figure 1* is a drawing ^f a pyramidal neuron from the sensori-motor cortex 
of a cat, This drawing was made from a tracing of three micro-photographs and 
shows very clearly the essential parts of the neuron, these parts being typicsl 
of the two basic groups of neurons, pyramidal and stellate, foung in the cortex 


* Reprinted with permission from D.A. Shoil, "The Organization of the Cerebral 
Cortex," 1956, John Wiley and Sons, Inc., p. 3. 
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Fa: Figure 1 Pyramidal Neuron from the Sensori-¥ctsr Cortex of a Cat 
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of most mammals , As to size of a neuron, a typical neuron may have a 

, ; A f 10 
perikaryon which measures from 10 to 100 microns acros: , There ace about 
101° such neurons in the human cortex, their density varying throughout tice 
cortex according t. the various functional regions. For example, in the 
human cortex, the motor arez has the lowest density and the v:sual area has 
the highest density, their average densities being in the ratio of about 1:3. 
With respect to over-all average densities of neurons the following table taken 


3 
from Sholl is enlightening S 
TABLE I 
Cerebral Cortex Neuron Density in Various Animal Species 


Cerebral Cortex Neuron 
Density in neurons per 


Species .001 cubic millimeter 
Mouse 142.5 
Rat 105.0 
Guinea pig: 52.5 
Rabbit 43.8 
Cat 30,2 
Dog 24.5 
Monkey 21.5 
Man 10.5 
Whale .8 
Elephant 9 


Using a vaiue of 10 neurons per ,001 cubic miilimeter for the cortex 
neuron deisity in man and a value of 10 microns for the diameter of a typical 
perikaryon, the result is that perhaps one to five percent of the total volume 


of tle cortex is occupied by the Perikaryon, leaving the rest to be fille” 


with ramifications of the dendrites, axons, and general celi nourishment 


supply, 


The system of communication between various points in the cortex is 
actually, at first thought, very “ample, the information being passed from 
neuron to neuron in a sort of chain linkage sequence, information arriving 
at the dendrites of any neuron being processed in a very particular menner 
and then being transmitted by the perikaryon down the axon to arrive at a 
dendrite or dendrites of the next neurons in the information transmission 
chain. However, when it is realized that as many as perh. ps 5000 ne 'rons 
may be influenced by only one neuron preceding them in a chain, and that eacn 
of these 5000 neurons may in turn influence that may more, then sore idea 
oz the co x.ty of the communication system may be obtained, When the 
various manners in which each neuron can be influenced--tc be discussed 
later--are considered, then the complexity becomes very large indeed, 

Figure 2* is a photograph of a section from the sensori-motor cortex of 
a cat. The method of staining the section--the Golgi-Cox method+-is such 
that only about 14 percent of the total number of perikarya and dendrites 
are made visible and so the total number of neurons in this section is about 
65 times greater than that shown, thus illustratine the almost impossible 
Complex cy present, Note the 250 micron dimension key in the lower right 
corner of the photograph. 

It is not the intert of the present thesis, “owever, to attempt is 
approach this complex a problem, but it is more the intent to separate the 
problem into an infinitely smaller problem and to study oniy a very small 
sub-section, namely that of tbe informational operation of the basic neurons 
with perhaps some interaction principles. Therefore the neuron will now be 


* Reprinted with permission from D.A. Sholl, "The Organization of the Cerebral 
Cortex," 1956, John Wiley and Sons, Inc., p. 6 
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Figure 2, Section from the Sensor) Motor Cortex of a Cat 


8 
described with reference to its role as an information Processor, Reference 
to Figure 1 in the following discussion will be helpful. 

Assume that there exists some neurons in a reuron net and that information 
is being transmitted through this net, The intormation is in the form of pulse 
interval mcdulated signais, That is, the information which leaves a neuron 
and enters the next postceeding neuron is in the form of electrical pulses of 
standard amplitude and length with the intervals between pulses being variable, 
These pulses originate in the perikaryon of the neuron. From here they propagate 
down the axon of the neuron in a manner to be described later, The axon is 
located such or is ramified so that it comes in close contact with the ramifi- 
cations of dendrites of other postceeding neurons, These contacts may also 
be on the main cell body us weli as on the dendrites, The contacts, known 
as synaptic knobs and/or boutons, have a vary particular function to be described 
later, but at present they can be considered as labile connections between an 
axon and a dendrite or perikaryon. Under the influence of the pulses from many 
different axons--just how many pulses and the time relationships between the 
pulses being dependent upon the physical location of the bouton, its labile 
state, and the threshold of the particular neuron under consideration--the 
perikaryon will produce a pulse output, that is, it will fire. Thus a complete 
transition of a pulse from one neuron through the next vostceeding neuron in 
the information chain has been qualitatively described, To better understand 
some of the details and to place quantitative ‘ralues on some of the variables, 
the chemical model of a nerve fiber will now be described. 


A nerve fiber may be regarded as an indefinitely lc z cylinder of reason- 


CO 
` 


ably uniform diameter which is filled with a watery medium cf special composi- 


tion, known as axoplasm., The fiber is immersed in a watery medium of a 


o 


be 


completely different composition, some filtrate of blood. The cylinder itself 
is an exceedingly thin plasma membrane of lipoid-protein structure which is 
only directly observable by means of an electron-microscope, its thickness beirg 
only from 50 to 100 Angstroms, Involved in the ionic hypothesis of the opera- 
tion of the nerve fiber are essentially only three elementary ions: sodium, 
potassium, and chloride, The membrane in its resting state--i.e., when no 
electrical impulses are being transmitted by the fiber--is readily permeable 
to potassium and chloride ions which diffuse through it and due to different 
concentrations of the different ions involved both inside and outside the 
cylinder establish a Donnan potential whose magnitude is about 75 to 100 
aiivus The inside of the cylinder is negative with respect to tne 
outside, The resting membrane is only sparingly permeable to the sodium ions 
with the result that a small number of them diffuse into the interior of the 
cylinder continuously. To prevent this diffusion of sodium ions from disrupting 
the equilibrium established by the potassium ard chloride ions, a sodium ion 
pump mechanism is hypothesized. This sodium-pump is located in the membrane 
and is driven in some manner from metabolic reactions within the fiber, By 
continuously removing the sodium ions from the interior of the fiber the sodium- 
pump keeps the concentration of sodium inside the nerve fiber at about 10 percent 
of the external concentration, 

A nerve impulse is initiated and transmitted in the following manner, 
The resting potential of the membrane is slightly diminished by an applied 
electric current or by a flow of electric current in an adjacent section of 
the membrane, This c@uses the membrane tc develop a high specific permeshility 
to sodium ions by means of some ''sodium-carrier" mechanism Y Thus the sodium 


ions rush inwards through the membrane and, being positively charged, rapidly 


10 
begin to neutralize the existing resting negative charge. The sodium ion 
current inwaras through the membrane is self~-catalytic; that is, as the current 
increases, the permeability of the membrane to sodium increases, resulting in a 
self-regenerating feedback, This process continues until the original charge 
inside the fiber has not only been nettralized but has actually become some- 
what positive with respect to the outside charge, At the same time that the 
"sodium-carrier" mechanism is beginning to fail when the nerve impulse is at 
its peak value, the potassium permeability of the membrane is greatly increased 
above its normal resting value and the potassium ions flow out of the interior 
of the nerve, In this way, the potential difference across the membrane is 
rapidly returned to its resting value. 

With the above explanation, it is immediately apparent how an i- pulse 
of potential is transmitted along a nerve fiber, for any change in > tential 
difference across a region of membrane will Sde a current to flow in an 
adjacent region. This current will depolarize the adjacent region wd thus 
inaugurate the chemical action explained Previously, Thus a ''smoke ring" of 
current will progress down the fiber, appearing electrically as a -egative 
voltage pulse whose amplitude is approxinately equal to the restiig potential 
of the membrane, i.e., about 100 millivolts and whose width is about 1 milli- 


second, 


Figure 3% is a drawing of a typical pulse obtained from a suid giant 


10 
axon, The pulse was detected by means of an internal electrr''2 inserted 


longitudinally into the nerve fiber which had been removed frc: the squid and 


placed in an appropriate chemical solution. The nerve was the: artificially 


*Reprinted with permission from J. C. Eccles, 


"The Neuro-shysiological 
Basis of Mind," 1953, Clarenden Press, p. 31, 


i 
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excited, The pulse is drawn so that it shows the potential of the outside 


electrode with respect to the inside electrode, 
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Figure 3, Action Potential Established by a Single Propagated 
Impulse as Recorded in a Squid Giant Axon, 


The preceding hypothesis of ionic operation of the nerve fiber when its 
equilibrium is disturbed implies that the resulting electrical pulse output 
is secondary to the relationship of the membrane and its associated ionic 
media on either side of it, However, since the present interest is primarily 
of an electrical nature, these pulses may be considered primary, and the 
nerve fiber considered only electrophysiologically,. 

One of the electrical characteristics of a nerve fiber which may be of 
interest since there is movement of charge through the membrane is the 
conductance of the membrane, This has been measured for several nerve fiber 
membranes and the resulting conductivities range from 140 x e mho per square 
centimeter for a squid giant nerve fiber to 8 x w mho per square centimeter 
for a sepia giant fiber, This latter is extremely small when compared to that 
of an equal thicknes.s of sea-water similar to that ın which the sepia axon is 
immersed, the sea-water having a conductivity of 4,5 x 107 mho per square 
centimeter--i,e. a value 5.5 x 10° times greater than that of the sepia fiber 


10 
membrane, 


12 
Because the electrical conductance of the membrane is extremely low, the 
membrane with its positive charges cn the outside and its negative charges on 
the inside may be thought tn have the properties of a capacitor, The sizes 
of the membrane canacities of the squid and sepia nerve fibers range from 
1.0 to 1.5 microfarad per square centimeter, If the potential across the 
membrane is 100 millivolts and the thickness of the membrane is 5C Angstroms, 
then the electric field strength in the membrane can become as great as 
2 x 105 volts per centimeter, This value is about 6 cr 7 times greater than 
the electric field strength required to break down an equal thickness layer 
of dry air at sea level pressure. 
Since the membrane has an electrical conductance and capacitance, ary 
change in potential across the membrane will decay exponentially with time, 
as in any resistance~capacitance network, with a decay constant equal to 
the product of the resistance per unit area and the capacitance per unit 
area of the membrane, This time constant has been measured with the 
following typical results: 1 millisecond for the squid fiber, 13 milli- 
seconds for the sepia fiber, and 4 milliseconds for the cat SE 
One other electrical characteristic may be of interest, That is the 
specific resistance of the axoplasm inside the nerve cylinder, This has 
been indirectly evaluated to be 30 to 60 ohm centimeter for giant axons of 
marine invertebrates and about 110 ohm centimeter for some frog nerve fiberd® 
The nerve fibers mentioned in all the previous explanations cre nothing 
more than the axons of neurons, There is very little difference electrically 
between the perikaryon and the axon and so the method of initiating and 
transmitting a pulse in the parikaryon is essentially the same as that given 


for the axon, The next question then seems to be how the impulse in the 


13 


perikaryon of a given neuron is triggered by pulses au:riviag trom other 
neurons, That is, what is the function of the dendrites aru tne boutons in 
1 depolarizing a localized regicn of the perikaryon or even t.e axon to the 
critical value so that the potential uecrease becomes self-regenerating and 
an output pulse from the neuron resu!ts? 
Assume that many pulses are active on various dendrites of a neurcn, 
z these pulses having gotten through the synaptic junction region. This is the 
region between the dendrite and the preceding axon and will be discussed 
later, The pulses on the dendrites travel decrementally along the dendrite 
since in the instance of the dendrite, it is such that self-regeneration of 
the pulse is restricted to only the subsynaptic membrane--i,e, the membrane 


of the dendrite immediately adjacent to the bouton, 1? Thus the pulse travels 


$ 
H 
H 
d 


along the dendrite as if the dendrite were a transmission line with a given 
propagation constant, As a result, many pulses arrive at the perikaryon from 
many different dendrites and from many different synaptic regions. At the 
perikaryon, the potential across any region of the perikaryon membrane is the 
sum of all the pulse potentials active at that region, Remembering that the 
pulses have traveled various distances along the dendrites and that even 
originally at the various E junctions, the pulses varied in amplitude 
and time, it is apparent that the potential of the perikaryon membrane is 

a combination spacial and temporal summation of the pulses influencing the 
entire dendritic region of the neuron. When this summation potential exceeds 
tLe critical potential at which the 'sodium-carrier'’ mechanism becomes self- 
regenerative-~this critical potential will henceforth be called the threshold 
potential--at any ' egion of the perikaryon or even on certain regions of the 


axon, then a pulse is generated at that point und is transmitted throughout the 
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axonal region of the neuron. “he thresholc is about 10% of the resting 
membrane potential and is a depolarizing potential. 

The synaptic knobs, known also as boutons, are extremely important 
functional] in the operation of the neurons, It is belizved thet these are 


the main labile units in the biological nervous system, although certainly 
not the only ones, Within the synaptic junction region, which is the 

region of connectivity between Lie axon of one neuron and the dendrites, 
perikaryon, and in some instances also the axon of the immediately post- 
ceeding influenced neuron, is contained the long-time storage units of the 
neurons and consequently of the nervous system, These plastic storage units 
store information of the type related to the past use and history of the 
junction. That is, the boutons vary in such a manner, at present not well 
understood, that the pulse effect from axon to dendrite is facilitated as the 
total information transferred across the junction is increased, Therefore, 
certain pulse conduction paths from axon to dendrite have greater influence 
or the output pulse of the perikaryon than do other paths, In this way, it 
is apparent that memory patterns cf events can be stored as conduction paths 
within a neuron net, 

There is apparently no actual connection between the axon and the 
dendrite at the synapse but it is believed that a ‘chemical transmitter"! 
See is active in transferring the effect of a pulse in an axon to 
a nearby dendrite at the synapse, However, this point need not be dwelt 
upon since only the total effect is important, 

A few quantitative details about the size and number of synaptic knobs 
per neuron may be of interest, Synaptic knobs having a diameter ranging from 
0.5 micron to 2 microns have been found in the Spinal cord. Any neuron surface 


is fairly well covered with these Knobs, as much as 40 percent of the surface 


15 
of the perikaryon and dendrites of a motoneurone, for example, with a total 
' 10 , ; 
of over 400 knobs having been counted on one motoneurone, Figure 4* is a 
photograph of a model of the perikaryon and large dendritic stumps of a 
mammalian motoneurone showing the synaptic knobs attached to tne surface, 
The storage of informaticn in the synaptic region can be summarized 
, 10 E ! 
quantitatively as follows: The facilitation which occurs after each 
active pulse at the synaptic knob decays with a time constant of about 
4 milliseconds, the normal decay of a regenerative pulse, The facilitation 
whicn results after many thousands of conditioning pulses at the synaptic 
knob decays with a time constant of about 80 seconds--i.e. at a rate about 
4 S 
2x10 times less than the single pulse facilitation, After the condi- 
tioned facilitation there is a period of residual facilitation which decays 
with a time constant of about 16 x 103 seconds--about 4,5 hours, This is a 
6 
rate of decrease of about 4 x 10 times less than the single pulse facilita- 
tion. 
10 ; F 
Eccles summarizes the excitatory action of a neuron in the following 
manner: 
"In synaptic excitatory action the following sequence of 
events occur when a presynaptic impulse propagates into a syn- 
aptic kneb. 
l. A brief delay of 0.3 to 0.4 millisecond, 
2. The development of an intense brief depolarization of 
the subsynaptic membrane with a total duration of about 0.5 
millisecond, This effect is attributable to a net inward move- 
ment of cations, though possibly a ne: outward anion movement 
might contribute, 
3. Due to local current flow into this "sinx! there is 


Gepolarization of the surface membrane of the soma (perykaryon) 
dendrites, and aujacent segments of the axon, This current also 


*Reprinted with permission from J, C, Eccles, "The Neurophysiological 
Basis of Mind," 1953, Clarenden Press, p, 110. 


Figure 4, Model of the Perikaryon and Large Dendritic Stumps of a Mammalian 
Mot oneurone 


generates the so-called focal and ventral-root synaptic poten- 
tials. Effects 2 and 3 together give the post-synaptic poten- 
tial as recorded intracellularly, 

4. If tne depolarization of some part of the membrane 
reaches a critical degree, an impulse is generated and spreads 
over the soma and dendrites and down the axon, i.e. there is a 
reflex discharge, 

5. Such an impulse destroys all the preformed post-synaptic 
potentials and is followed by the large positive after-potantia). 
that is characteristic of the neurone. 

£., If no impulse is generated, the post-synaptic potential 
decays exponentially with the electric time-constant of the 
neuronal surface membrane, which is about 4 milliseconds. ilowever, 
it appears that the peak of the post-synaptic potential is usually 
slightly prolonged by the depolarizing action of local responses 
of the post-synaptic membrane, 

Each presynaptic impulse independently produces its own post- 
synaptic potential, Generation of an impulse is dependent on the 
summation of such unitary post-synaptic potentiais to give the 
critical level of depolarization," 


Only excitatory action by impulses have been spoken of thus far. 


These have caused a depolarization of the nerve fiber membrane with the 


ultimate production of an output pulse provided the depolarization was 


great enough, One might ask, however, if instead of depolarizing the 


membrane, what would happen if it were hyperpolarized and if such an 


operation of the membrane does take place? The answer to the first part 


is that the membrane would be inhibited from "sodium-carrier'™ mechanism 


depolarization and the answer to the second part is that membranes do 


undergo this hyperpolarization by a process called inhibition, 


The hyperpolarization caused by inhibition has been detected and 


measured by intracellular electrodes, the interior of the membrane becoming 


more negative in potential and the exterior of the membrane becuming more 


positive, There is as yet however, no general agreement as to how this 


hyperpolarization occurs nor as to how some pulses active at certain 


synaptic knobs cause depolarization and other pulses active at other 


i : 10 
synaptic knobs cause hyperpolarization. 


Eccles concludes that inhibitory 
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Synaptic action is caused by some specific "chemical transmitter" substance 
being .iberated from the inhibitory synaptic knobs just as excitatory synaptic 
action is caused by some ''chemical transmitter" substance being liberated from 
the excitatory synaptic krobs, ro 

The electrical effects of inhibition are practically the inverse of 
excitation, That is to say, pulses which cause a region of nerve membrane to be 
depolarized have their exact counterparts in pulses which cause a region to 
be hyperpolarized by the same amount. Under ideal conditions of certain size 
pulses and location of the given region of membrane, ar excitatory pulse 
and an inhibitory pulse would exactly cancel each other in their effects on 
the potential difference across the membrane, Therefore the inhibition may 
be considered as a pulse by pulse inhibition just as the excitation may be 
considerad as a pulse by pulse excitation, 

One other major point about a neuron remains to be discussed before 
leaving this section. That is the threshold of a neuron and how it enters 
irto the over-all operation of the neuren and its net and how the threshold 
changes with activity and time. This threshold is considered to be rather 
important in the neuronal net operation since its value directly affects 
the production of an output impulse by a neuron, 

The threshold 3. e the critical value of potential change across 
a nerve fiber to caise an iupulse~-is about 10 percent of the total 
membrane potentiat difference, Therefore, any change in the potential 
across the membrane will affect the threshold. Since the potential is a 


function of the various concentrations of potassiur, chloride, and sodium 


ions on both sides of the membrane, anything which changes these concentrations 


weet 
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wili change the .otential, Thus the chemical environment of the neuron can 
change its threshold or the chemical nourishment which changes the icn 
concentrativa inside a neuron can change its threshold, For example, hormones, 
enzymes, drugs such as tranquilizers and stimulants, and so forth, can change 
the chemical ion concentration about the nerve fiber membrane, These changes 
in threshold are rather slow as compared to the previously mentioned normal 
inputs to the neurcn but they are nevertheless very important, since these 
changes will certainly determine tne over-all activity of the nervous system. 
The threshold changes caused by the above chemical concentration changes are 
the result of additions or depletions to the neurons through the blood supply 
and associated body cell nourishment sources, Therefore these changes are 
regional since many neurons in given neighborhvods are affectcd. These 
chemical inputs - -if they may be called that- -are then very slow changing 
inputs of a non-individual neuron variety as opposed to the previous pulse 
type inputs which are very rapid changes and which are of an individual 
neuron variety. 

In addition to the chemical input threshold changes as just indicated, 
there 1s also a fatigue effect of the chemically determined threshold, For 
example, the interior of the nerve can be depleted chemically by continuously 
high output pulse repetition rates since some potassium ions flow out from 
the interior of the nerve fiber each time a pulse is developed or transmitted 
and if the puise repetition rate exceeds tne value at which the potassium 
ions can be replenished, then ultimately the output repetition rate mist 
decrease, 

Having now discussed various facts about the neuron, a short qualitative 


summary is in order before proceeding to a short diccussion of the cortex 
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region of the nervous system and the connectivities between neurons present 
in the cortex, The neuron can be briefly summarized as follows: 


l. The neuron is a functional unit which utilizes as its output a 


pulsed code which is an all ~ or - none device, This pulsed form is only 
characteristic of the axon purtion of the neuron. 

2. The responses of most parts of the neuron as a result of input 
pulses do not determine output pulses directly, but help to determine the 
initiation of an impulse at some critical rer“on of the perikaryon or 
base of the axon, 

3. There is decremental conduction along or through the dendritic 
region of the neuron, but in the axon and axon region the conduction is 
decrement free—~—i.e, no attenuation, 

4, The synaptic regions of the neuron are the malleable --~-i.e, 
labile--portions of the neuron where variable facilitations of the incoming 
pulses are experienced. These regions are the plastic storage units of 
the nervous system, 

The neurons which have been discussed thus far have not been of any 
specific type, although some of the data have of necessity been rather 
specialized with respect to the source of Ae neuron- -i.e, its original 
host such as squid, crab, frog, cat, human, etc, It is generally accepted 
that neurons are rather the same functionally, no matter where they are 
topologically located, although certain rather general classifications of 
neurons can be made such as efferent or sensory neurons, afferent or 
motoneurones, and so forth, These classifications are rather of a specific 


use classification, however, and not an internal functioning classification, 
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Therefore the neurons in the cerebral cortex probably function in the same 
manner as has been described for the rest ot Ae neurons. 

The cerebral cortex is a rather extensiv convoluted layer of neurons, 
the average thickness of which is about one-quarter of a centimeter, the 
total surface ar2a of both hemispheres is about 2300 square centimeters, 
the total volume is about 575 cubic centimeters, and the total weight is 
about 1350 grams, 38 The total number of neurons contained within this 
cortex is between 10° and TM) Each neuron may influence by its axon and 
adjacent dendrites from other neurons as many as 5000 other neurons. Thus 
it is apparent that amongst the problems related to the organization of 
the cortex are the total number of neurons involved, and the connectivities 
between neurons, since large groups of neurons are always active when any 
activity of the cortex is considered, These problems then are obviously 
of a statistical nature, 

However, as indicated previously, it is not the problem of this thesis 
to study any such gross a problem, the only interest at present being to 
Study the operation of small groups of artificial elementary components and 
their connectivities, these artificial elementary components having 
some of the electrical characteristics of a biological neuron, The 
philosophy involved in this problem and some of the past and present 
approaches to the realization of an automaton to enswer some of the questions 


involved will be discussed in the next chapter, 
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3. PHILOSOPHY AND MODELS OF ADAPTIVE AUTOMATON 


3.1 Philosophy 
The problem th-t now must be answered seems to be one of method and 
Magnitude also. For exampie, it has been stated that there are about 
10 : , ; 
10 neurons in the human coriex, A moments thought will surely reveal 
the nuge task of attempting an analysis of such a system, even in very 
gross terms; for assuming only one percent of the neurons are necessary, 


the result is still 10° elements. If these elements are of the simplest 


8 
i , i l 
type of binary output device, this means that there are 2 S (i.e. about 


3 10 
ey possible output states of the svstem, But this is an 
extremely simple approximation because the i..put conditions have not been 


stated. When even the simplest input conditions are assumed, such as each 


typical neuron having a minimum of 100 bifurcations in its dendritic 


2 
structure, then each neuron has as many as 4 9 possible input states, 
d 
l EE 6 x 109 
Therefore a conservative estimate of (4 ) — -i,e, about 10 ~- 


possıble states exists for the system, Therefore the model of the 
biological system will certainly be restricted to something considerably 
less in number of total elements. 

Again, considering the number of elements which certainly are 
sufficient, the question rises as to just how many may be necessary. 
This question cannot, at present, be answered since it would involve at 
least some additional knowledge and understanding about the internal 
operation and connectivities involved in the cortex, To arrive at even 


z rough estimate of the total number of elements involves a guess, but it 


“pgs 
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"mm ihat certain animals of a very limited intelligence have only a 
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few hundred neurons—-for example, the e.rthworm has about 200. Therefore, 
it seems reasonable that the total number of elements required for a 
machine of limited biological operational behavior will be between 50 and 
150, or possibly 200. 

fo present this seems to be about all one can say with respect to 
the magnitude of the system, It is now, perhaps, in order to discuss the 
method of arriving at the structural details and the philosophy cf tke 
individual elementary components —-artificial neurons as they are some- 
times known, However, betore discussing what appears to be at least 
two approaches to this probiem of method, some general thoughts about the 
system will be stated, 

It was stated in the introduction that the basic interest is that 
ot the design of biological computers, As such, certain limitations of 
design seem to have been automatically implied, For example, the system 
will be composed of elementary components whose functional operation is 
fairly complex compared to that of the general analog or ‘igital computer, 
That is, the elementary components must each be capable of performing 
Many operations which are delegated to different parts of the ordinary 
computers ——for example, input, output, addition, control, storage, etc, 
This is to say that the system envisaged should not be made of many 
different types of elementary components, each with its particular 
function, but should be constructed of a minimal number of reasonably 
complex functional types of elements so that the operations involved in 
the system adapting to its environment will be distributed functionally 


throughout the totality of elements. 
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With regard to the adaptation of the system to its environment, a 
statement can be made about what is not wanted. This is: adaptation 
by total enumeration of all previous system fact history with later 
adaptation by means of enumeration and decision based upo. that enumeration, 
This statenent requires some explanation. 

One manner by which any system, biological or artificial, could 
adapt to its environment would be to store all its experiences in a 
fact catalog type storage which was complete in all respects, AS new 
experiences were met, the total fact storage would grow and continue to do 
so indefinitely throughout the system's existence, As the system met a 
particular condition in its environment it would search its catalc; 
storage systematically and if the conditicn had been met previously, it 
would react according to its previous successful reaction, If the condition 
were a new one in its exis-ence, it would have no basis for any particular 
reaction and so would react randomly, but would record that reaction. 
If the reaction proved successful from an existence criterion, the system 
would henceforth react to identical conditions in the same manner. If 
the reaction were in some manner unsuccessful but the system still survived, 
then the next identical condition of the system and environment would be met 
with a different reaction, And so the process would continue throughout 
the system's existence, 

There are several undesirable features anc weaknesses to the above 
method of benavior determination, The first, and most obvious, is the 
large storage required if the system is to completely catalog all details 


of its experience for a considerable time of existence, The second 
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undesirable feature follows directly from the first and is the time 
required for the system to make a decision each time it encountered 

a condition cf the environment, This would become greater and greater 
as tne experience of the system increased, and could become excessive. 
The third feature could be classified definitely as a weakness from a 
system survival standpoint, That is, if a condition arose which 
threatened the system's existence, even though it had successfully 
encountered that condition previously, the storage search time might 
be so great that the system's existence terminated before it reacted 
favorably to the condition, The fourth feature is also a weakness of 
some importance, particular.y with regards to concepts formed by the 
system, In particular, che system with unlimited storage and access 
ability would probably not form concepts but would continue only to store 
individual facts and not relate them to each other, 

Thus one of the primary requirements to be placed upon any 
adaptive system would seem to be that of placing a limit on its storage 
capacity so that its method of adaptation to its environment will be 
fundamentally one of conceptualization and not of cataloging facts in 
unlimited storage, 

Having now discussed some of the general qualities desired in an 
adaptive system, it now becomes necessary to consider ways and means of 
approaching the problem of design of this system, In this connection 
there are at least two different general philosophical methods which scem 
to be at the two extremes of adaptive design philosophy, One is the 
definition and determination of system goals and the resultant system 


synthesis using the definitions as guides. The other is the construction 
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of a system uSing elerentary components of extreme informational 
flexibility and the resultant analysis of that system, The former is 
the approach of going from the general system to the specific component 
whereas tho latter is the approach of going from the general component to 
the specific System, Both approaches have advantages and disadvantages, 
some of which will now be discussed, 

The first approach of establishing a goal and then building the 
System to meet the goal would seem to be, at firsv thought, rather 
desirable. Here the goal of adaptability is defined by the system designer, 
using any methods which are considered necessary to arrive at the defin tion, 
Then the designer goes about synthesizing the elementary components or other 
components which wili ultimately be used by the system, Since the system's 
goal and operating procedure for obtaining that goal has been established, 
it would seem that the only problem facing the designer is one of 
Synthesization. The synthesizing of the appropriate elements, however, -- 
although somewhat established by physics and engineering --isS certainly not 
a completely Straightforward procedure and thus this method is not as Simple 
as it appeared at first. In addition, there is a tremendously deceiving 
assumption in the method, That is that the system's goals can be aprivrily 
decided so that the system will be adaptive, These goals are as yet unknown 
and so €ach syStem designed in this manner will be dependent upon the 
designer's use of information theory, logic, Physiology, juccition, etc, 
Thus when the difficulty of synthesizing elements and the doubtfulress of 
the appropriateness of an apriorily chosen goal for an adaptive system are 


both considered, the previously seemingly logical method of solution is open 


to question, 
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Almost diametrically opposed to the approach just described is 
the second previously mentioned approach, that of designing extremely 
informationally flexible components and from these constructing specific 
systems, There is some reason to believe this method may be slightly 
more desirable than the former method, but some may take issue with 
this argument, For example, if the elementary components are made as 
flexible as the biological neurons then the existence of the biological 
system can be used as an existence proof that an adaptive system can be 
constructed from the flexible elementary components, Thus the system 
designer has first the preblem of constructing elementary components 
which are considered to be as flexible as are the biological neurons 
of certain living organisms, Here he has the help of all the previous 
recorded research of the various pertinent biological sciences to aid in 
the determination of the flexibility required, Then he has the problem 
of assembling these components into various specific systems and then 
analyzing these systems to determine if thev are adaptive, It would 
thus seem that once the elementary component requirements are established 
using the physiological neuron as a guide, it wovld be only a question of 
complexity of connectivity of these components to achieve an adaptive 
system. 

However, there are also some subtleties of design involved in this 
approach that have not been mentioned. These are the establishment of 
the flexibilities required for the elemeniary components, It has been 
assumed that enough knowledge is presently available about the operation of the 


physiological neuron to make a choice of information handling requirements 
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possible, but this may not be true. There may be certain features 
about the neuron which are not presently suspected which contribute 
appreciably to the functioning of the system, In the final analysis then, 
this latter approach also depends 3 good deal upon the designer's use 
of logic and intuition for its design, Thus it would seem that this 
method is also open to considerable question, 

Therefore there appears no certain method of approach to the 
problem at Present, but it is hoped that a combination of these two 
approaches will lead to a system which will exhibit adaptation to a 
limited degree, More about this will be stated in the next chapter 
along with the general specifications for the general elementary 
components to be considered, It is now of some interest to discuss 


some of the machines wnich have been constructed or contemplated, 


3.2 Models 

With respect to machines whicn have been constructed for the 
purpose of simulating some behavior chavacteristics of a biological 
system, on va few of the many will be aescribed, These few seem, at 
present, to represent the most advanced models, and only two to be 
described have actually reached the physical existence stage of develop- 
ment, the remaining ones being partially constructed or Simulated, When 
considered from the reference frame of an engineer or physicist, two of 
the machines seem rather simple and uninteresting, but when considered 
from the standpoint of psychology, their behavior is somewhat suggestive 


of animal behavior, That is, when the machines are considered with their 


basic elementary component operational laws fully understood, they may 


a or 


a Parner ars 
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be considered uninteresting by some observers, but to individuals who 
dc not have access to the basic units and their operation, the machines 
do indeed exhibit external behavior similar to animais, In a similar 
context, with the operational laws known only to a certain degree or 
accuracy~—as is actually the case in all machines- —then even to the 
physical scientist the operation of the machines hold an interest 
since they then become not wholly predictable but only statistically 
so. Thus the following machines are of interest to all observers 
because of the promise they hold forth for the development in the 
future of machines which are adaptive to their environment. 

c 2,1 Machina 3peculatrix 

Machina speculatrix--or the tortoise as it is better known—- 
was designed and built by Walter, an English physiologist, as an 
attempt to produce a model resembling an animal- -at least in action, 
though not necessarily in appearance, By action is meant some measure 
of the following attributes of life as indicated by Walter: 
exploration, curiosity, free-will in the sense of unpredictability, 
goal~seeking, self-regulation, avoidance of dilemmas, foresight, memory, 
learning, forgetting, association of ideas, form recogaition, and the 
elements of social accommodation. Before describing the physiological 
accomplishments of the machine and its electronic Circnit, a short 
qualitative description may be helpful. 

The machine is constructed in such a shape as to remind one 3f a 
tortoise, hence its name, Figure 5* shows the general construction details, 


It is a three-wheeled battery-powered vehicle, the single front wheel 


* Reprinted with permission from P. de Latil, "Thinking by Machine," 


1957, The Riverside Press, p. 50. 


Figure 5, Walter's Machina Speculatrix 


being the only driven wheel, This wheel is driven in two ways, one a 
traction diive which causes the wheel to rotate on its axis and hus 

move the tortoise, and the other a steering drive which causes the plane 
of the wheel to rotate about a vertical axis and so guide the tortoise. 
Both drives are from two separate electric motors which may be opezated 

at two different speeds, depending upon the setting of their particular 
control relays, These relays are indirectly controlled by two receptors, 
one of which is a photo-electric cell and the other a limit switch 
attached to the hull of the tortoise, The photo-electric cell is mo:nted 
on the steering column of the front wheel so that the cell always faces 

in the same direction that the wheel is being driven, The steering 

motor runs continuously at full speed when no light is active on 1.2e photo 
cell, end so the photo cell scans an entire 360° steadily. When any light 
of moderate intensity enters the photo ceil, the steering rotation and 
consequently the scanning, is Stopped, When light of more than moderate 
intensity excites the photo cell, the steering motor runs at half speed. 
The driving motor is also controlled by the photo-electric cell, the 
result being that the driving motor operates at half speed when the cell 
is inactive and at full speed when the cell is activated by either moderate 
or intense light, The limit switch is forced closed when the tortoise 
hits somethiug or when a slope is encountered, This connects the output 
of an internal photo-cell amplifier back to its input through a capacitor-- 


the resulting connection forming a low frequency relaxation oscillator, 
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These oscillations alternately connect the steering motor on full and 
half power and the driving motor cn haif and full power respectively 
while also making the photo cell less sensitive to light. The over-all 
resuit of the closing of the limit switch is to produce a turn and push 
maneuver which is quite effective in getting around any objects which the 
tortoise may encounter, 

The actions of the Mechina speculatrix are very suggestive of those 
of a restless animal, In the dark it wanders rather aimlessly, encount- 
ering objects and maneuvering around them, Any light of moderate intensity 
attracts it and it immediately moves in the direction of the light, again 
maneuvering around any objects in its path, I+ avoids an extremely bright 
light except when it is "hungry'--i.e. when its batteries are low in 
charge —-at which time it makes all possible haste to the bright light, 
When the source of this bright light is tne tortoise's hutch, it enters 
and makes the appropriate electrical connections automatically so that 
its batteries are recharred. When the batteries are fully charged, the 
tortoise backs from its hutch and proceeds to wander around its environment 
as before until its batteries are again low when it goes back to its 
hutch and repeats the charging cycle. 

With regard to the physiological principles exemplified by Mechina 
speculatrix, the following are those which Walter claims for his Creation: a 

i, Parsimony is illustrated in the tortoise by its economy of structure, 
the machine containing two units corresponding to nerve cells-~—i.e, there 
are Di vacuum tubes, two relays, two capacitors, two electric motors and 
two batteries, These two sensory detectors are affected by two sensory 


receptors, a photo-electriec cell corresponding to a light receptor and a 


Limit switch corresponding to a touch receptor, 


2. Speculation is really the faculty which gives the tortoise 


its biological name and distinguishes it from some other machines, The 
machine is in a constant state of change and exploration. This is in 
Opposition to the action of the Homeostat to be described later which only 
seeks a state of stability exhibited by lack of all action, Few machines, 
including computers, exhibit spontaneous investigation., 

3. Positive tropism is exhik.ted by the tortoise's motion toward 
a moderately intense light. The beginning of this motion is immediate 
upon the reception of a light signal by the phow cell and since the 
steering motor is stopped by the light activating the photo cell, the 
movement towacd the light is rather direct with few maneuvers, 

4, Negative tropism, on the other hand, is exhibited by the 
avoidance of bright lights, obstacles, and hills. These avoidance 
Maneuvers are ail obtained by use of the same operational components used 
for positive tropism but automatically connected to function differently 
under the appropriate stimuli. 

5. Discernment between effective and ineffective behavior is 
accomplished by the limit switch operation. Upon coming into contact 
with an object or encuuntering too steep a slope when it is loving 
towards a light, it immediately "forgets" the light and begins the task 
of avoicing the obstacles in its path, after which it again moves toward 
the light. 

6. Optima rather than maxima conditiors are sought, This is shown 
by the tortoise seeking moderate intensity lights but not bright lights. 

7. Self-recognition by the tortoise is shown with the aid of a 


pilot lamp at the front which is lighted at all times other than when 
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the photo cell receives an adequate light signal, The light from the 
pilot lamp is sufficient so that when it is reflected from a mirror or 
white surface reasonably close to the tortoise, the photo cell is 
activated, This starts the machine moving toward its own reflection, 
but meanwhile the pilot lamp has been extinguished, thus stopping the 
motion toward the reflection. This process repeats with the over-all 
effect being one of an aninal observing its own reflection and mov ing 
around in various positions before the reflecting surface, 

H. Mutual recognition of two tortoises, attracted by each other's 
pilot lamp, cppears as a result of an action on the part of each similar 
to the self-recognition action above, That is, each is attracted to the 
other by the opposite pilot lamp, but when one sees the other's pilor 
lamp, it immediately turns off its own lamp. This removes its attractive- 
ness to the other tortoise and the other tortoise begins to wander off. 
At this the first tortoise's lamp is again lighted and the other tortoise 
is again attracted, This process repeats indefinitely for both 
tortoises with the result that there appears an action similar to an 
animal's recognition of another of its species, 

9. Internal stability is exhibited by the fact that a moderate 
intensity light attracts the Mechina speculatrix but a high -ntensity light 
repels it under normal conditions, However, when the batteries are low 
in charge, the internal stability is upset and moderation gives way to 
the desire for "food", Thus the Mechina speculatrix is attracted toa 
bright light. If this light happens to be the one in its hutch, then the 


oatterles are recharged and Mechina speculatrix is revit 


alized, However, 
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if the bright light happens to be a fire, then the machine might very well 
be destroyed in its guest for "food", 
About the cperation and characteristics pertaining to self-recognition 


ge `; ; ; 7 
anu mutual recognition of his tortoises, Waiter has this to say, 3 


"It may be objected that they are only 'tricks', but 
the behaviour in these modes is such that, were the 
models real animals, a kiologist could quite 
legitimately claim it as evidence of true recognition 
of self and of others zs a class, The important 


feature of the effect is 'he establishment of a 


feedback loop in which the environment is a component," 


Figure 6 is a diagramof the electrical circuit of the Machina 
speculatrix, The diagram is self explanatory, any of the vario.s modes 
of operation of the machine being fairly obvious once the circuit is 
studied, However, the mere Simplicity of the circuit and the complexity 


of operation possible is one of the values of the automaton, 


3.2.2 Homeostat 


The aim of Ashby when he built the machine bearing the name Homeostat 
was to illustrate mechanically--—i.e, in a non-living organism- --the 
principle of homeostasis and particularly ultra-stability as he defines 
it. It is therefore useful to define these terms before discussing the 


machine itself, 


toot 2 7 
Ashby uses the term homeostasis in the same sense as Cannon and 


it means essentially the faculty possessed by a living organism to maintain 
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Figure 6, Circuit Diagram of Machina Speculatrix 
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itself in a rclatively constant state of equilibrium. In particular, 


Ashby prefers to call this adaptation and defines it thus: 2 dE) 
form of behaviour is adaptive if it maintains the essential Variables 
within physiological limits." The essential variables referred to by 
Ashby are in particular such variables in living animals as are closely 
related to survival such as pulse rate, blood pressure, body te:.perature, 
respiration rate, etc, 

Ultrastability as used by Ashby is closely related to stability. 
Ashby's definition of stability is: S "Given cn ahsolute system and a 
region within its field, a line of behaviour from a point within the 
region is stable if it never leaves the region." An absolute system is 
one whose line of behaviour in phase Space from a phase point is always 
the same independent of how the system arrived at the phase point in 
question, For stability, then, the lines of behaviour of the system 
always remain within a region considered as the region of stability, 
The principle of ultrastability as stated by Ashby is a "An 
ultrastable system acts selectively towards the fields of the main 
variables, rejecting those that lead the representative point to a 
critical state but retaining those taat do not.'' Thus the ultra- 
stability criterion has the added feature over the stability criterion 
of requiring a change of phase space variables if the phase point is 
unstable. That is, ultrastability provides a means of stabilizing a 
point ir phase space by selectively changing the range of the variables 


involved, 


The machine built to illustrate ultrastability -i.e. the Homeostat - 
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consists oz four identical units as shown in Figure 7 and diagramed in 
Figure 8, Each unit has a magnet pivoted about its center on top of 

the unit, the angular deviation of the magnet about its pivot point 
being the main variable, The output of each unit is an electric current 
whose amplitude and direction is proportional to the magnets deviation 
from its central rest position, the deviation Leing either positive or 
negative, 

The deviation of the magnet determines this output current in the 
following manner: The magnet has attached to it a wire which dips into 
a trough of water, The trough of water has a potential gradient in it 
determined by electrodes at either end and is so placed that as the 
magnet pivots, the wire picks off a potential dependent upon the position 
of the magnet, This potential is fed to the grid of the triode (see 
Figure 8). When the potentiometer, E, is properly adjusted to gi zero 
output current for a central location of the magnet, then the deviation 
of the magnet will cause an output current, the direction and magnitude 
being dependent upon the magnet position, 

The different units of the homeostat mav be joined together so that 
each may influence the position of the other's magnet throu_1 the coils A, B, 
and C seen in Figure 8. D is a feedback coil from the unit itself. The 
magnitude and direction of these input currents to each unit's coils may 
be determined manually by the switches, X, and the potenticmeters, P, at 
each coil, 

When the units are connected together as described and the system is 


* Reprinted w th permission from P. de Latil, "Thinking by Machine," 1957, 
The Riverside Press, p. 274 
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Ashby's Homeostat Unit 
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Figure 8. Circuit Diagram of Homeostat 
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energized, the magnets are influenced in such a manner that one of two 
things may happen, If the system finds itself ina region of the phase 
space where it is stable then the pattern of behaviour of the magnets is 
such that they move to the central position of their iimits of movement 
and resist any attempt to displace them. If the system finds itseif in 
a region of instability due to the switch and potentiometer settings, 
the pattern of behaviour of the magnets is such that the magnets diverge 
from their central positions resulting in a state known as unstable. 

The system described above is a dynamic system of four variables 
whose phase space is determined by the switches, X, and the potentiometers, 
P. for a total of 32 parameters, For some parameter settings it is 
unstable and for others it is stable, but it is not ultrastable for any 
parameter settings, 

If the switches, 5, are set so that the inputs bypass the X's and 
P's and pass through the uniselector, U, then the system becomes ultra- 
stable, In this new position of the Switches, S, the values of the X 
and P parameters are determined by the uniselector, U. Each uniselector, 
consisting of all three U components on the diagram of Figure 8, isa 
stepping relay containing 25 positions, Thus there are 390, 625 combina 
tions of input parameter values determined by the total of four uni- 
selectors, one on each unit. 

The uniselector coil, G, on each unit is energized only when 
sufficient current flows through the output and closes the relay, F. This 
occurs for a particular unit when its magnet diverges to a particular 


position in either direction from its central location —~that is, when the 
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system exhibits instability. As Jong as the magnet position is beyond this 
critical value, the uniselector will continue to change the input parameters, 
If the range of values of input parameters on each uniselector is sufficiently 
great, it is apparent that a combination of parameters--in fact many combina- 
tions--for all units exists which will stabilize the system. 

The system just described now exhibits ultrastability and is the complete 
Homeostat, Any subsystea composed of one, two or three units joined together 
is also ultrastable and so also exhibits homeostasis, It should now be 
apparent how the ultrastable system differs from the stable system, The 
stable system contains parameters which are fixed and permanent in range with 
the result that the region of stability remains fixed, On the other hand, the 
parameters of an ultrastable system are variable in range so that the system's 
region of stability can be changed. Its operation consists of a set of trans- 
formations of the phase space until a region is found which is stable. When a 
distrubance takes the system out of the region of Stability, the system trans- 
forms to a new region in phase space, ultimately ending in a new Stable region, 
This is the entire goal of the Homeostat. 

The Homeostat is an attempt to build a model of the survival equilibrium 
achieved by a living organism, It attempts to accomplish this by means ot 
several independent units--each of which is stable in itself--reacting upon 
each other, The result is that achievement of equilibrium is exhibited by the 
Homeostat becoming insensitive to its environment and even resisting any attempt 
to displace the magnets from their resting position, Thus the Homeostat 
becomes dormant and uninterested when it has achieved its goal. This leads 
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Walter to conjecture that perhaps it iS more like a plant than an animal, 


3.2.3  Perceptron and Other Models 
aS Se ee eee 


The two machines described thus far are physically existing machines ane 
are rothcr simple in componentry and circuitry, On the other hand, the Per- 
ceptron, a machine designed by Rosenblatt”? for the purpose of perceiving 
and classifying stimulus patterns active at its input, is not in existence, 
That is, as yet, it is in the stage of a theory of operation of a machine 
which has been simulated in a certain sense by a digital computer, The theory 
of the Perceptron is not based on simple Components and circuitry, but upon 
rather complex units similar to biological neurons, In fact, the proposed 
operation of the Perceptron is very similar to the operation of the brain 
as proposed by Hayek? 3. 

The operation of the Perceptron is dependent upon the statistical connec- 
tions possible between three basic types of units, The sensory units are 
transducers between the environment and the Perceptron. Their purpose "e 
to code the various stimulus patterns into a form understandable by the 
association units of the Perceptron and to distribute this coded information 
amongst all the association units in a rather random manner, The association 
units ar2 information digestive units vhich are so interconnected and so 
numerous in number that the result is a statistical analysis of the input 
information. When the results of these association unit's analysis are fed 
to the response units, which are the final units of the Perceptron, the over- 
all response of the Perceptron becomes a function of the input stimulus 
patterns, Rosenblatt?’ shows mathematically that such a machine will statis- 
tically separate and classify environmental invariants after a training 
period. Implied in this theory is the fact that the number of units and 


their possible interconnections in the Perceptron is so great that detailed 
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knowledge about them at any time is practically impossible, Therefo-e any 
ultimate understanding of the operation would have to be based upon some 
kind .f a statistical analysis. 

Pask takes a somewhat different but nevertheless a rather intriguing 
approach to the problem of adaptive organization, His philosophy seems to be 
that it is only relevant to study the interaction between two systems to decide 
whether either system is adaptive and to judge whether the over-all organiza- 
tion is meaningful. This philosophy is partly exemplified by some of his teach- 
ing machines, the punch card operator trainer being a typical example, "S 

This machine presents to the operator trainee a set of punch card symbols 
in a certain Sequence and with a certain time interval between symbols. The 
operatcr in turn must punch a corresponding symbol on a keyboard after being 
presented a symbol by the teaching machine, The time required for each symbol 
presentation and corresponding operator respoase is recorded by the machine 
and this information is used to influence the machine's particular symbol 
sequence and time of symbol presentation in future exercises, Thus the 
machine paces the trainee's performance by setting a rate of operation depend- 
ent upon the trainee's past performance for a particular sequence of symbol pre- 
sentations., In this way, the teaching machine continually examines the treinee's 
performance and attempts to correct deficiencies by appropriate adjustment of 
rate of operation, Thus the teaching machine and operator become a total 
system, each part adapting to the needs of the other in a particular functional 
manner, The result, to quote Pask ia T... that a teaching machine is some- 
thing like an adaptable artificiai limb, or an adaptable notebook, namely a 


piece of his Surroundings which the trainee fashions ^and uses," 


4. PROPOSED ADAPTIVE AUTOMATON 


4.1 General Description 

Having completed the description sf two generally basic approaches 
to the problem of designing an zutomaton which will embody some of the 
behaviour characteristics of a biological system, and before stating what 
are believed to be the minimum requirements of any elementary components 
to be used in the construction of a general self-organizing Sutomaton, a 
short qualitative lescription of the proposed automaton and its operation 
will now be given. 

The automaton will be composed of many elementary components, 
customarily known as artificial neurons, which are all essentially alike 
functionally, These elementary components are connected to each other in 
a "very general manner''--to be explained later--such that the information 
flow between elementary components is through a variable conductance path 
called a facilitator, The conductance of the facilitator is time and use 
dependent. That is, the more a particular facilitator is usee with respect 
to the total information transferred by it in a given time, the greater is 
the effect of that information upon the receiving elementary component. 

The effect of the facilitator may be considered as a variable gain 
whose value is dependent upon the time integral of the information flow 
through it. Thus the gain of the facilitator is the ratio of the magnitude 
of the output energy of the facilitator to the input energy to the 
facilitator where both energies are those connected with the coded informa- 
tion being transferred through the facilitator--i.e. the signal energy. 

As a result of the facilitators, preferred paths of information flow 
within the machine will be established, these paths being dependent upon 


the information content, its code, its source in the sense of its input 
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location in the machine, and the total information stored or in transit 
Within the machine, Thus the state of the automaton and its changes of 
State will be dependent upon the stimulus history of the machine, 

For example. the automaton might be started at some given time 
with the initial conditions of the facilitators such that no connectivities 
were present between any cf its elementary components. As the automaton 
received information from its environuent in the form of stimuli patterns, 
either the same pattern or various patterns, paths of connectivity 
between the various particular input elementary components and the other 
elementary components of the automaton would Le 2stablished and wouid 
increase in gain, thus facilitating the infornation transfer over 
particular paths, The establishment of the information paths and the 
iniormation flowing through the automaton would constitute some activity 
within the automaton, and for a given input stimulus pattern, activity 
would result which was characteiistic of that particu-ar stimulus pattern, 

The observations of these activity patterns by an observer who may 
be a set of "appropriate observation equipment" will constitute an output 
of the automaton. Since the response of the automaton is de endent upon 
the past nistory of the environment acting upon the automatc’ tke response 
of the automaten to a given input pattern can be called an adaptive 
response, 

If the "appropriate observation equipment’ considered previously con- 
sists only of another large group of elementary components which are 
functionally like the elementary components used in the rest of the automaton, 
and if these "appropriate observation equipment!’ components are connected 


informationally to each other and to the automaton by means of facilitators, 
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then the totality of automaton and observing automaton can be considered 
to be another automaton which can conceivably become self-recognizing. 

The automaton with these farilities will then hcve a capabLlit:: 
of "learning"! since certain responses are characteristic of certain 
input stimuli and these responses in turn modify the exis ling stares 
of the automaton, With a complete feedback loop from automaton "ouput?! 
to automaton "input through some ''environment'— that is, with the 
addition of components which modify its environment which in turn will 
modify the automaton cennectivity - -the automaton will have an adapt- 
ability to an environment different from itself. 

With regard to the ''very general manner"! of connecting the 
elementary components, a comment may be made, Theoretically, a possible 
information path or facilitator could be connected between each elementary 
component and all other elementary components; in fact, many paths 
cs -Id be connected since these paths may be functionally different -—- 
for example, excitatory, inhibitory, threshuld, etc, However, in bractice, 
a laminar connectivity scheme will Bobebly be used, This means that a 
number of elementary components are connected together to forr a group of 
components and then several of these groups are in turn connected to- 
gether in some sequential manner, It should be remembered that these 
connectivity paths are only possible facilitation paths, the actual 
final paths being determined by the pattern activ -y history of the 
automaton, The elementary component to be used in an automaton such as 
that which has just been briefly described can be qualitatively classified 


as a highly diversified data processor which utiiizes the information 
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present at its input in many different ways, For example, it is a 
summer, it is a storage unit, it isa correlator, it is a variable 
gain detector, and finally, it is « signal standardize:. These various 
functions will become clear when the specific requirements of the general 
elementary component are enumerated later, In this sense then, the 
adantive automaton just qualitatively described is quite different from 
the general present computing machines since in the present computing 
machines, the various functions suck as arithmetic, storage, input, 
output, control, etc, are localized in separate specialized portions of 
the machine whereas in the Proposed adaptive automaton, functions 
corresponding to these are present in all the components and sv are 
distributed throughout the automaton, That is, a standard computer 
compartmentalizes its function and a biological computer distributes, 
i.e, decompartmentalizes, its functions. 

e Now that a very qualitative description of a general adaptive 
Eege has been given, the specifie requirements for the general 
elementary components to be used in the automaton will be stated and 
explained, 

4,2 Elementary Component 

As described in Chapter 2 of this thesis, Physiological nervous 
Systems use pulse code to transfer information when this information is 
of an iiamediate point-to-point type, By immediate point-to-point 
information is meant information which influences, and is being 


immediately processed by, various large < -tions of the system over 


reasonably short periods of time, This point-to-point, immediate effect 


information is of a short time nature as opposed to that of the regional, 


Jong time effects such as chemical stimulants, tranquilizers, metabolism, 
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etc, The pulses which carry this sho-t time, point-to-point, information 
arz believed to be the only carriers of information associated with this 
particular effect, Therefore, the pasic elementary components, ulso 
known as artificial neurons, will be desip.ied to transmit and receive-- 
process --information by means of pulses whose spacing in time vary. 

This type ot modulation is known as pulse interval modulation. 

The output of the elementary components will be pulses . 
standardized shape and amplitude, the intervals between pulses being 
functionally related to the varied functional inputs of the particular 
elementary component. Each elementary component will have one output 
terminal to which many other elementary component input terminals may 
be connected, either by moans of facilitators or directly. Iowever, 
there wiil be many input terminals which have a large variety of 
functional effects upon the output of the elementary component, Thus 
the elementary component may be considered as a very flexible correlator 
whose transfer function will be dependent upon both spacial and temporal 
distribution of inputs from other elementary components, 

Keeping in mind, then, the two general approaches to the problem 
of constructing a predictive model of a biological system in the sense of 
nervous behaviour characteristic and leaning very heavily upon the 
naturally giver existence theorem as exemplified py the many biological 
systems in the present world, the minimum requirements of the elementary 
component to be used in the construction of an automaton, called an 
Adaptive Reorganizing Automaton, will now be enumerated, 

l. The first requirement is that all information or data transmission 


which is of an immediate problem nature and is primarily point-to-point 
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will he by pulses which are basically pulse interval modulated, This require- 
ment is primary because, as mentioned previously, it is generally ac epted that 
the immediate flow of information in a physiological neuron net is by pulse 
interval modulation and it is the present desire to study artifacts resembling 
as closely as possible physiological systems, Another reason for oulse interval 
modulation is the realiability of detection and restandardization oi pulses at 
points where information is processed, i.e, at the elementary components, 

2. The output pulses from the elementary components will be standardized 
tc a constant amplitude and pulse length. This requirement certainly follows 
the natural system as a guide for there seems to be no appreciable difference 
With respect to pulse shape and size between the pulses which originate at any 
one area of the cortex at various times or even between any area of the cortex 
and other areas either at the same time or difierent times, even though func- 
tionally the various regions of the cortex are quite difiterent, In aecdition 
to using the physiological systems as a guide, technologically it is desirable 
to have the pulse output from each elementary component standardized, For 
exemple, modification of the pulse amplitude and width can then be reserved 


as operations to be performed at only certain points in the system which are 


under definite control and observation. Therefore, points of information or 


data control and reduction which may be monitored will be available in the 
automaton, 

3. The greatest output pulse average repetition rate will not exceed 1000 
to 1500 pulses per second, This is a rather Arbitrary limit which is based 
partly upon similar limits found in physiolcgical systems and partly upon the 
generally available instruments to be used for output or behavior determination 


of the complete automaton. For example, high speed photography of the operation 
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of the automat on--to be discussed lLater--would record and separate pulse 
rates in the range of about 500 to 1000 pulses per second, 
4. The least output pulse average repetition rate will be not less than 
10 to 15 pulses per second when the elementary component is actively correlat- 
ing the input data present at its many input terminals, If the least average 
repetition rate becomes less than this rate, then an autonomous generator 
will act to trigger the elementary component and an output pulse will result, 
The lower Limit of correlated pulse repetition rate is arbitrury as to actual 
value but it can not be zero, for with the existence ofa lower limit of zero 
pulses output, --which means there is no pulse activity from a given elemen- 
tary componuent--it is conceivable that the totality of elementary components 
d in the automaton would become inactive, either due to a lack of stimuli of 
sufficient amplitude and intensity or due to a complete lack of stimuli. 
This inactivity is contrary to most biological systems since the generally 
accepted fact is that physiological neurons exhibit some pulse activity even 
when they are not stimulated at their inputs, This is apparently ever true 
when the number of neurons considered is very smail and isolated from neigh- 
boring neurone it? ©. 

5. The duty cycle of the output pulses will be 30% or less when the 
pulse repetition rate is a maxi: um, This requirement is simply a close 
approximation to the physiological system, 

6. When a given element component is stimulated at a constant input 

' rate for a length of time, either all the inputs or any number of its inputs 
j being stimulated at various individual constant rates, then the output pulse 
repetition rate will tend to decrease with time; that is, the elemertary 


component will show signs of fatigue and lack of correlation with respect to 
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the input, The physiological systems show this tendency to a greater or 
lesser degree amongst the different species and also this tendency seems to 
be desirable so as to prevent saturation of any of the nets to the exclusion 
of other nets under prolonged fixed pattern siimulation, Wthout this 
property a biological system would show extreme attentiveness under certain 
stimuli patterns and indeed, undesirably, some individuals do have extended 
pattern fixction when subjected to certain stimuli for extended periods of 
‘ime; for example, under certain fatigue Conditions’) 

7, The output pulses of an elementary component will be essentially 
independent of the number of inputs to facilitators or to other elementary 
components which are connected to its output, Another manner of describing 
this requirement is tnat the output impedance of the elementary component 
will be small in comparison to the input impedance of the components which 
are connected to it. This prevents any "loading"! effects upon the elementary 
component, 

8. At least three functionally different types of input will be required 
for each elementary component correspondir to the electrical and the chemical 
inputs in a physiological neuron plus certain manual inputs tu allow control 
of the elementary component by an observer for purposes of study and analysis 
of the artificial neuron nets, These inputs will give the elementary compo- 
nent extreme flexibility with respect to data processing which in turn will 
make the automaton more versatile. 

The various inputs will be as follows: 

a. Excitatory input with the various folowing attributes, 
(1) Pulses which are active at the input and of amplitude 
great enough to raise the internal triggering energy above 


some excitatory threshold value (to be explained later) for 


d 
i 
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a time, Ôt, greater than about 25 microseconds, will cause 
the elementary component to Produce a pulse at its output, 
Hereafter this act of producing a pulse by the elementary 
Component will be spoken of as "firing'', 
(2) Two or more pulses at the input whose individual amplitudes 
are less than the excitatory threshold may be summed over a 
period of time, At, of xu ont 0.25 millisecond to cause 
firing of the elementary component provided their sum is 
greater than the excitatory threshold value for the required 
time, ôt. 
(3) After firing, the elementary component will exhibit an 
absolute refractory time cf about 0.5 millisecond during 
P which time it cannot fire under any conditions, After this 
absolute refractory time it will experience a relative 
refractory time of several milliseconds during which time 
it becomes increasingly sensitive to input pulses, 
(a') The conditions for excitation as stated above may be simply 
: defined as follows: An elementary component will fire if 
the excitatory input energy causes the internal triggering 
energy to exceed a particular excitatory threshold energy. 
This requirement and the action of the elementary component 
corresponds quite closely to the functioning physiological 
neuron with respect to the excitatory input, 
b. Inhibitory input with the following attributes. 
(1) Pulses which are active at the input and of amplitude great 


enough to lower the internal triggering energy will prevent 
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or inhibit the elementary component from firing fora 
refractory period, AT,~--dependent upon input pulse 
amplitude--from the time of the input pulse, The pain 
of the inhibitory input section should be such that the 
effect of a identical pulse input to both the exci ry 
and inhibitory inputs simultaneously prevents the elementary 
component from firing. 

(2) Two or more pulses at the input whose individual amplitudes 
would not affect the internal triggering energy may be 
summed over a period of time, At, of about 0.25 milli- 
second to inhibit firing of the elementary component. 

(b') The conditions for inhibition es stated above may be simply 
defined as follows: An elementary component will be inhik- 
ited from firing if the inhi*‘tory input energy exceeds a 
particular inhibitory threshold ¢cnergy, This requirement 
is very similar to the inhibitory action in a physiological 
neuron in that they are both essentially pulse by pulse 
inhibition, 

c. Excitatory and inhibitory inputs Simultaneously stimulating an 
elementary component will fire the elementary component only at 
` those times when the excitatory pulse energies are greater instan- 

taneously than the inhibitory pulse energies for 2 period of time 

which is dependent upon the relative magnitudes of the immediate 

past input pulse energies, This requirement is merely a result 


of the previous two requirements, a and b, 
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d. Threshold input with the following attributes, 


(1) 


(2) 


(3) 


Pulse input threshold will have some of the characteristics 
of an excitatory or an inhibitory input dependin. upon the 
particular elementary component but with a much less effect 
per pulse and a much longer renction time. Th.s means, i: 
effect, that many pulses from many other elementary components 
will be summed over loug intervals of time anu will thus 
@s.ablish some ievel of triggering energy which is not 
Strongly influerced by incividual pulses but is more a 
measure of activity of several interacting elementary 
components, 

Continuous input threshold will consist of fixed level 
transfer of triggering energy between elementary components 
This means that when two elementary components are con- 
nected through these terminals, the componenis average 
triggering energy levels at those points will be the same, 
These inputs then are bilateral in the sense that they are 
both inputs and outputs depending upon the particular direc- 
tion of flow of data as contrasted to the pulse inputs of 
requirement d(l) which are unilateral, receiving data only, 
The continucus input thresholds correspond to the chemical 
thresholds of physiological neurons, 

Manual threshold will be simply an individual average trig- 
gering energy level control of the elementary component and 
amounts to an energy level control which desirably can be 


varied between limits which will either make the elementary 
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component autonomous at the high energy level or completely 
inoperative at the low energy level. The requirement of a 
manual threshold control is desirable from a research stand- 
Point since it gives flexibility and controlability to the 
automaton, Quite obviously, there is no physiological 
euron input which corresponds to this requirement, 

The effects of various input pulses to the elementary component are sum- 
marized in Figure 9, The graphs of excitatory input pulses, inhibitory input 
pulses, internal energy level, and output pulses all versus time illustrate 
the operation of the elementary component very well, Particularly important 
an the undersiauiing of the operation is the internal energy level diagram, 

On this is illustrated the fact that when the trigger energy curve and the 
threshold energy curve intersect and overlap for a time, ôt, then an output 
pulse results, After this a period of absolute refractory time occurs, 
followed by a decay of the threshold toward the quiescent value, Also clearly 
shown are the effects of various amplitude pulses, both excitatory and inhibi- 
tory, upon the trigger energy ievel, It should be noted that for purposes 


of illustration varying amplitude input vulses have been used. but similar 
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effects would result from varying pulse widths instead of amp.itudes, 


4.3 Facilitator 
The Facilitctsr corresponds to the "bouton terminal"! part of a physio- 

logical neuron as previvusly described. The "bouton terminal" is the adaptive 

section of the neuron in the sense of storage of information for long periods 


of time and adaptability to neighboring neuron environments, and thus is the 


plastic storage element in the cortex, Since it is intimately connected to the 
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Figure 9, Control of Elementary Component by Various Input Pulses 
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neuron body or perikaryon, it is properly a part of the physiological neuron, 
but in the automaton proposed, the facilitator is a separate and self-existineg 
component. This--as will be seen later--is desirable for purposes of flexi- 
bility of desi-n and construction and also for purposes of flexibility with 
respect to the use of the automaton, The facilitator so conceived will give 
the automaton the ability to change its function with regard to its environ- 
ment, both present and past. It is only by means of these malleable units 
which are here called facilitators that the automaton's behavior becomes a 
function of time and environment ani thus can even be considered to have 
uny adaptive features, Therefore the components representing the facilitators 
become the essential elements of the automaton, Keeping this in mind, the 
following are the requirements of any facilitator units. 

1, The facilitator will modify either the amplitude, the length, or 
both, of the pulses which are active at particular inputs, This modification 
will be a function of the facilitator's information transmission rate and can 
be spoken of as the gain (gain is the same as that defined on the first page 
of this chapter) of the facilitator. This requirement is obvious since only 
these two parameters--namely, amplitude and pulse width--reuain as variables 
in the pulse interval modulation code which has been adopted as the means of 
transferring information in the automaton, 

2. At least three functionally different types of inputs will be 
desirable to provide flexible gain control of the facilitator, One of 
these corresponds to the physiological synapse while the other two will be 


used to determine the effects of both positive and negative facilitation in 


WI 
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the automaton, The inputs to any facilititor will be the following: 


a, 


Positive fnciilitation will be a pulse input which has a trans- 
fer funct on--j.e. a gain--which is modified by the rate of 
information flow through the facilitator and by the time the 
facilitator has been in operation, That is, the sain, G, of 

a facilitator is a function of time, t, and the rate of intor- 


mation flow, dH/dt, as follows: 


dH 


ER 


The positive facilitation will thus transfer a pulse from input 
to output after operating on the pulse with a gair, G. This 
gain will increase the energy content and consequently the 
effect of the pulse upon the elementary component as a result 
of the positive facilitation. 
Negative facilitation will be a pulse input like the positive 
facilitation put with two different effects, It will decrease 
the energy content, ard consequently the effect of a pulse upon 
the elementary component, and also there will be no transier to 
the output o: pulses active at the negative facilitation input-- 
only pulses active at the positive facilitation input are trans- 
ferred to the output with variable gain. This allows feedback 
from any point in the automaton to control a facilitator's 
gain without this control information interfering with the 
original transferred information. 

An example of where this would be useful may clear up the 


details, Assume that the output of an elementary component is 
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connected to the negative facilitation input of a facilitator 
whose output is connected directly to the elementasy component 
in question, Then when the elementary compenent fired, the 
puise would reduce the gain of the facilitator without inter- 
fering with the original information. This method of contrul 
of the gain of a facilitator offers one possibility for the 
prevention of saturation of the facilitator, This connection 


is shown in Figure 10, 
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Figure 10, Illustration of Negative Facilitation Control 
of Facilitator 2, 


With respect to the relative gain changes caused by the 
same pulse being active at both the positive facilitation and 
negativ. facilitation inputs, the effect of one input snouid 
exactly cancel ne effect of the other, with any unbalance being 
in favor of the negative facilitation. Thus the gain of a facil- 


itator can be controlled and prevented from saturating, 
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c. Manual facilitation input will be manual control of the sain wf 

the facilitator, This will allow the gain of the facilitator to 

oe set at any value from zero to maximum for either giving the 
automaton an arbitrarily determined memory, destroying part of 
its memory, or special analysis experiments, 

3. The facilitator saturation time from zero gai Will be about ten 
minutes, 11S means that the time required for the gain of the facilitator 
Lo chan from zero value to maximum value shoul.) be about ten mint‘ os when 
lt is being excited continuously by pulses ct its input which have a repeti- 
tion rate of about 200 to 300 pulses per second. This requirement is an 
attempt to duplicate reasonably closely tne action of a physiolorical 
synaptic junction although the data available are rather Limited, McCulloch 
has Suggested that the ‘learning time" of a natural neuron may be from two to 
twenty minutes, and so ten minutes seems to be a reasonable compromise,” 

4. The facilitation decay time from maximum gain will be quite long, 
probably hours. Here again there is very little data available, so this 
time is at best a reliable guess. 

The Facilitator output is shown in Figure 11 for various input pulses. 
The four graphs illustrate respectively various pulses at the positive 
facilitation input, various pulses at the negative facilitation inpu. the 
facilitator gain resulting from the inputs, and the output pulses fra the 
facilitator, It will be noticed that output pulses only result when pulses 
are active ai the positive facilitation input ard are not oresent when the 
negative facilitation input alune is active, Also apparent from the facili- 


tator gain curve is the decay of gain between pulses--tor example AG foi a 


given time At, 


* Personal communication with McCulloch, 
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Figure IL, Control of Facilit.tor by Various Input Pulses 


4.4 Automaton Assembly 


Having specified the requirements for the various Date components to be 
used in the general adaptive automaton, the discussion can now be turned to 
the manner of assembly of these components, With respect to helpful hints 
from neurology as to the manner of assembly of the physiclogical neurens in 
a biological system, the data avrilable are very limited and so are of iitvle 
value, and thus neurology offers small help, However, since one of the pur- 
poses of the automaton is the study of the basic principles of operation of 
an adaptive system and particularly the Study of the connectivities »ossible 
between ‘artificial neurons, the following comments about the automaton 
assembly will be stated with these purposes in zand, 

Probably the most important requirement with rospect to the autometon 
assembiy-~and perhaps the only actual requirement--is that of instrumenta- 
tion of the automaton. The problem of instrumentation of the general adap- 
tive automaton must rece: e special attention and so will be discussed ina 
separate section, Therefore it is suificient tọ state here that, with 
respect to the automaton assembly, adaquate consideration for the detection 
of the operation of the automaton must be given, That is, each component 
wili require access terminals from which information about itS operation and 
particular state may be obtained, Also the mode of connection of the various 
components must be such that information may be obtained about the connection 
as to location as well as about its pulse history, This means that the 
various paths of activity of information flow within the automaton, as previ- 
ously indicated, can then be adequately observed and monitored. 

There are other features which should be considered in the assembly. 


For example, the structure of the ~hysical Comp: ent so that it will be 


convenient to connect them together into any of many different systems. 
There is also the matter of data recording, Since the coimponents will be 
connected together in many different ways to form different Systems, some 
thought should be given to the geometrical placement and construction 
rigidity of the components so as to facilitate identification of tie various 
units when studying the systems, These various points will be covered when 
the specific automaton is described, 


In summary, then, all the specifications and comments about the general 


automaton assembly are for purposes of making the device functionally flex- 


ible so as to make it a good investigatory instrument, 
4.5 Instrumentation of the General Adaptive Automaton 

If the intents and purposes of the general adaptive automaton are to be 
fully realized, then the instrumentation of the device for detection of its 
operating states is extremely important, That is, one of the primary purposes 
of constructing any self-organizing automaton as an investigitory instrument 
is to study its k ohavior and operation, with the implied motive of learning 
as much about its principles of operation as possible, It is then obvious 
that the automaton must be as tnoroughly instrumented as is practical. But 
with perhaps tens or hundreds and possibly thousands of elementary components 
in the automaton, it becomes quite appareni that the complete detailed opera- 
tion or behavior becomes impractical to monitor and record, To do this o uld 
require far more equipinent--even many times more--than the automaton itself 
contained, which is already appreciable considering the complexity of each 


elementary component and the facilitators connecting these components, 


Therefore a compromise between the ideal Situation of monitoring every detail 
of operation and the absurdity of monitoring nothing must be met, 

The previous requirements of the automaton assembly Indicated a necessity 
of obtaining information from each elementary component and facilitator during 
operation of the automaton, It is now apparent thee inis -annot be done in 
a simultaneous manner from all the ccmponents in a complex ugtomation., How- 
ever, it is possible to select relatively large groups of compcnen’ , either 
spacially or topologically related in the automaton, and observe~-ile, moni- 
tor--their operation individually by means of some reasonably chesen metha s 
of detection, chese methods being dependent upon the particular type of 
automaton under study, such as chemical, electro-chemical, electrical, mechan- 
ical, etc, 

For example, each automaton having been constructed by an individual or 
group of individuals, will be limited, in a certain manner, at each junction 
or information exchange point, as to its total number of variables possible. 
Perhaps the range of variables will not be known nor even all of the possible 
types of variables, but certainly, within limits, the creators of the autom- 
aton will know the variability of the automaton at the component level. The 
detection of the values of the variables then becomes only a matter of 
attempting to monitor each of the variables in the best manner possible for 
that particular variable under consideration. With this in mind, the foilow- 
ing requirements for the monitoring and analysis of the operation of the 
proposed general adaptive automaton will be given, These requirements are 
considered minimal from the reference frame of the automaton’ s desipners 


and thus seem to be sufficient requirements, 


1, The input and output activicy of any elementary component and its 
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immediately preceding facilitators will be measured by some type of indicating 


devices, This means that indicators of the type that show the presence or 


absence of pulses at the aforementioned points must be available in suftic- 


ient quantity to indicate the activii: of either a single component or of 


any group of components whose number is not below about 10% of the total 
elements in the automaton, The 10% figure of desirability is presently 
arbitrary and can only be justified intuitively, ‘These indicators must not 
"load" the automaton in any manner which interferes with its normal function- 
ing and should indeed have no effect upon the operation of the automaton, 
Thus they may be removed and inserted at any point in the automaton and will 
» truly fle?ible indicators with respect to placement, The indicators so 
chosen should--perhaps with the aid of auxiliary equipment—--be capable of 
indicating not only the presence of pulses but also the pulses' amplitudes 
and their placement in time relative to all other pulses being detected at 
various other points. These indicators will probably be at each location 
for reasonably long times; that is, for times longer than the transient 
times of the automaton being studied. 

2. The transduction points between the automaton and its environment 
will be monitored, In general, there will be two types of transduction 
points, those that are considered as inputs to the automaton and those that 
are considered as out Ate from the automaton, The types of equipment used 
to monitor these points will be the same generally as those used in require- 
ment l. However, the same flexibility with respect to topological placement 
is not required at the input and output because these points will be continu- 


ously monitored during the entire operation of the automaton, This applies 


particularly to the output, since here the instrumentation essentially is a 


Fart of the output transducer from the automaton to its environemnt., With 


raspect to the input, the monitoring instruments can be a part of the input 


transducer and so may be considered Separately from the automaton, However 


it seems more desirable to have both the input and output monitoring instru- 


ments as part of the general adaptive avccomaton equipment, 


3. The third and probably the most important requirement of the instru- 
mentation will be the measurement of any Correlation between input activity 
and output activity. This means a method of recording simultaneousiy for 


a 


period of time tie indications obtained in requirement 2, This correlation 
and its change as a function of time is one of the primary reasons for the 
construction of the automatun because this will reveal the degree of self- 


organization or adaptivity present in the automaton, This particul ` cor- 


relation requirement may be met in practice by the use of standard digital 


or analogue computers used as the correlation storagc and measuring equip- 


ment in conjunction with properly designed transducers mapping from the 


JAAP ive automaton code to the digital or analogue computer code, However, 


this is getting into the specific instruments to be used, and so will be 


properly another part of this thesis. 


5. FINAL DESIGN OF THE ADAPTIVE REORGANIZING AUTOMATON 


9.1 General Comments 

A general adaptive automaton has been described in the preceding chapter, 
along with some rather idealistic requirements for that automaton, Since the 
problem is now one of constructing a specific device, these specifications will 
serve as a guide in the final design specifications. The specific automaton, 
known as an Adaptive Reorganizing Automaton, is an attempt to build a system 
which will exhibit a minimal number of behavior characteristics of a biological 
system. Its purpose will be mostly investigatory in nature and so an attempt 
will be made to meet as many of the ideal specifications as possible, 

When the requirements stated in the previous chapter are carefully 
considered, it soon becomes apparent that they are the specifications of a 
device which is functionally very flexible. That is, the requirements of the 
automaton are such that, if they are all met, it surely seems that the system 
may be flexible enough functionally to meet its proposed purpose. Therefore, 
since the requirements are rather varied, it would perhaps seem to be advisable 
to use techniques taken from many different fields of science for the final 
design. For example, the information carrier energy could be based upon 
electronic designs, the control sections ot the components could be Perhaps 
electrical or chenical, the storage sections of the units could be chemical or 
mechanical apparatus, etc. These various types of apparatus would then be 
joined together with the appropriate transducers between them, thus completing 
the system, 

These were some of the thoughts when the design was started. After 


exploring some of the various chemical and mechanical approaches to the design 
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of different functional units, it became apparent that if che basic automaton 
signal energy was to pe of an electrical origin--and this fact wns accepted 
because the existing techniques of electronic engineering are very well suited 
to the requirements ¿i the signal energy--then it would be much Simpler and 
more expedient to make the entire system an electronic one rather than to mix 
chemical, mechanical, and elec’ rical Components, with the associated necessary 
transducers, into one system, Also, the all electronic system offered certain 
advantages with respect to the availability of component parts ind the required 
assembly procedures, Therefore, che design of the first model of thc Adaptive 


Reorganizing Automaton solidified into a complete!» electronic design, 


Having thus decided to construct an electricai adaptive automaton, the 


decision was next made to use solid state devices as much as practical, This 


was based upon the fact that for the large nunber of elements involved in the 
construction of even a rather limited automaton, the presence of tubes and 
their associated heat dissipation in the heaters becomes somewhat undesirable, 
Also, Since the levels of operation are low both in frequency and amplitude, 
and the fact that operation is by pulse -echniques, the use of transistors 
seems almost ideally suited to the construction. This requirement was satis- 
fied to a limited extent but unfortunately coulc not be completely met econom- 
ically--but this will be explained later, 

The most important practical problem to be considered when the construction 
of the Adaptive Reorganizing Automaton was undertaken was the cost per unit 
since this cost was what ultimately determined the total complexity of the 
device. Therefore, the components which are described later are definitely 
compromises, with the complexity desired for each component somewhat relaxed so 


that a reasonable number of total components could be built and operated. 


& 


Once the over-all requivemenis menticned had been chosen, che immediate 
question of component design was considered, The question as to how complex 
an individual component should be was an important part of that consideration, 
For example, an individually very complex component culd be constructed which 
conciined ali the essential functions of the ideai elementary component and 
its associated facilitators and then the zutomaton would consist oi only these 
components in different arrays connectivity. The connectivities between 
comnonents then would be simply wires. This approach could be made to have as 
much ultimate flexibility with respect to connections as any approach but 
would be less ec nomical because in many of the individual components all the 
possible connections to and from it would not be utilized and for particular 
experiments would not be wanted. Thus considerable dupiication of sections of 
components would result, Another important deficiency of this method of design 
is the difficulty of modification of the automaton by additions to it of other 
diversified units, That is, if it was decided to add a unit other than between 
the presently existing components, tie components themselves would require 
modification; and since the present Adaptive Reorganizing Automaton is the 
first model to be built, this deficiency could be serious in the future use 
of the automaton, 

Almost diametrically opposed to the extremely flexible and complex 
functional component approach to the automaton component solution is the diver- 
sified component approach finally adapted in the design of the first Adaptive 
Reorganizing Automaton, This design consists of several flexible and function- 
ally different components, each component type having some of the requirements 
of the previously mentioned very complex component and each component type being 


compatible with all the others so that they may be connected together by means 
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of wir + in many different configurations, Under certain connection conditions 
W a group of these components woula then have the same flexibility and function 


as one of the very complex components. 
For example, the Elementary Component was divided into three functionally 
different units. These are two Energy Transducer units and an Autonomous 
` Component unit, These units will socn be fully described, so it is sufficient 
to state now that by separating the very complex Elementary Component into 
S much simpler units, it was possible to achieve units which are fairly simple 
in operation, but whose possible interconnections make for a very flexible 
automatot Therefore this design has the advantages of the previous pronvosed 
design plus many other qualities which were considered important, such as 
minimum duplication of component functions for economy of construction, 
S minimal Component function for greater ultimate diversification of automaton 
experimental use, less technical skill required for construction and maintenance, 
— and greater flexibility of component additions to the automaton for future 
experiments, both anticipated and not yet anticipated, 
The rest of this chapter will be devoted to the functicnal description 
S of each of the components used in the Adaptive Reorganizing Automaton, The 
l circuit diagrams of these components wili be found in the Appendix along with 


an explanation of the electronic operation of each, A discussion as to the 


various possible connections and the detection of operating details will be 
given in a later chapter. 

A comment about the nomenclature to be used is now in order, Ali input 
and output signals from the various components will be considered as pulses 
unless otherwise specifically noted, All pulses will be of the same length 


denoted as standard and their amplitudes will be given by a ratio relative to 


72 


7 
í 


the standard pulse amplitude denoted as unity or l, Thus every pulse is normal- 
ized to the standard pulse, The symbol W will denote an instantaneous potential 
cutput level, pulse or otherwise, and the symbol Z will Similarly denote an 
input, These symbols will be subscripted by other symbols, th: first indicat- 
ing the unit of the general Component "dich is the source or sink as the case 
mov be, the second indicating the general component fom which the pirticular 
Strnal is arriving, and the third indicating the general component to which the 


Signal is going, For example, Won would be a pulse output of given umplitude 


D 


from the X unit of the ji th general component and going to the k' th general 
component~-i,e, it is the input to asit associated With the k' th general 
component, All the values for W or Z are instantaneous potentials above the 
common reference point, ground. A general component as used here is an assembly 
of units which together will have most of the attributes of an ideal Elementary 
Component as described previously, That is, an Energy Transducer with its 
associated Facilitators and Autonomous Component would constitute a general 
component, Thus a general Comp: ent is essentially an artificiai neuron. 
It is aiso to be understood tha there is a time delay, Dr. between the arrival 
of any triggering energy into a: output unit and the resulting output pulse, 
~is applies particularly to the Energy Transducer to be described later, ôt 
+s a function of trigger pulse amplitude and of continuous input threshold »ase 
amplitude to be described later in detail with the description of the Energy 
e Transducer, 
v.2 Energy Transducer 

The snergy Transducer is the part of the Adaptive Reorganizing Automaton 
wich contains some of the functions of the biological neuron cell Dody. Its 


function is the assimilation of information arriving at its inputs from many 
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different sources within the automaton, For this purpose, there are two main 


functional sections, the pulse unit and the summer unit as shown in the block 


diagram of Figure 12, 

The pulse unit is the immediate output unit of the Energy Transducer and 
is nothing mere than a pulse standardization circuit which produces a standard 
output pulse whenever the input potential is above some threshold level, O 


A? 


for a minimum given length of time, Therefore the X unit has a transfer func- 


tion as follows: (Refer to Figure 12) 
W =1 when Z .,>0 for a length of time > ôt 
xjk Ajj v 
(1) 
= 0 when Bas does not satisfy above condition. 
where: 


Kap is the instant eous output potential of the X unit (always 

a Standard pulse output). 

Sg is the instantaneous input potential of the X unit, also the 

instantaneous potential value of the output of the summer unit to 

be described later. 

©, is the threshold potential value of the X unit which determines 

firing of the unit. 

Ôt is the minimum length of time required for the input potential to 

exceed 2, to cause an output pulse, This Ôt is not a constant but is 

somewhat dependent upon the magnitude of SC above Ə., and is also 
dependent upon the immediate past history of the X unit. 

The summer unit is the control unit of the Energy Transducer in the sense 


that it determines the level of the instantaneous input potential to the pulse 


unit. The functional operation of the summer is qualitatively described as 
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Figure 12. Energy Transducer 3lock Diagram 


foliows, The manual threshold input is a manual control which establishes a 
fixed Doter" "al component of the E vut Dor ntaal, The rontinusus input 
threshold is a direct current inpu. which adds a varying potential component 

to the DV output potential, the Ate of variation being rather slow. No pulse 
Variations are present in this input, This input is also the only input which 
is bidirectional, being either an input cr an output under different conditions. 
The threshold innut is a pulse input which also adds-~-or subtreci copending 
upon the particular Fnergy Transducer--a varying potential component to the X 
output potential, the rate of variation Leing somewhat greate: than the contin- 
uous input threshold but definitely not of a p.ise py pulse nat e That is, 
this input integrates the input puises over a time interval many times greater 
than the average interval between pulses. The excita ory input is a pulse 

input which adds a pulse potential component to the © output potential, the 

rate of vaciution being practiculiy the same as that of the pulse input with an 
input pulse integration over a time interval only a part of the average interval 
between pulses. This allows two pulses arriving at slightly different times 

to be summed, The inhibitory .put is a pulse input which performs in a manner 
Similar to the excitatory input but which subtracts a pulse potential component 
from the 2 output potential instead of adding a pulse potential and which also 
has an equal or greater absolute gain than does the excitatory input, Thus 


the transfer function of the X unit is the following, 


WV së rk + (ki "dt, (Œ k. ER 
Ojj j £ LEE ee ee j L iE) 
t>>T t<T 
3 k 2 
Lë noLny (2) 


where: 


Woy; is the output of the © unit (not a pulse but a unidirectional 
JJ 


varying potential). 


@ is the value of potential established manually, 
J 


SS wi E, Kk,, and k, are constants of their respective networks, 
SE wl i 1 
=e is the value of potential at the respective continuous input 
3 


threshold inputs, 


KÉ , is the instantancous value of the pulse amplituae at the respective 
BJ 


threshoid input, 
E Zeii is the instantanecus value of the pulse amplitude at the respective 


excicatory input. 


an is the instantaneous value of the pulse amplitude ut the respective 


inhibitory input. 
T is the average time vetween puisces, 


(+) in the pulse threshold tarm is either an additive or a subtractive 


"Tech, e 


term described iater in the text, 


means the integral is over the preceding time interval many times 
t>>T 


greater than the average pulse interval, 


means the integral is over the preceding time interval much less than 
t<T 
the average pulse interval. 


Note that the integrals above serve not only as pulse counters but also 


produce a potential which varies as the amplitude of the pulscs counted. That 


i is, the integral gives a potential which is both a function of the number of 
1 pulses and the amplitude of the pulses, This is necessary because at various 
ants n the circuits being considered, information is present both as amplitude 


TT 
and number of pulss and so the integral notation is correct, Any discrep- 
ency which might secor apparent dimensionally is corrected by the appropriate 
constants, 


Upc. setting = Z 1s indicated in Figure 12, Equations (1) and (2) 


Wes 
Jjj *JJ 


combined kecone the tre .sfer function of the entire Energy Transducer, 


Thus 
W. zl when Z >0 for a time > ôt 
zjk DCK d 
= 0 W eh Z byt oe O (3) 
S f 
with: 
e SS 
Z.. =0 A ZkÉ + (2k Z .)dt + X Zk. Z jdt 
“jj j £ e E See Tgi Ke cig? 
t>>T t<T 
e 5 
J: = rag 
t<T 


The circuit, which is fully described in Appendix A, is such that certain 
Limitations an" operating conditions are present, For example, immediately 
following an output pulse, an absolute refractory time of about 0.25 milli- 
seconds exists during which no input energy can cause the elementary component 
te f.re, After that a relative refractory period of 2 to 3 milliseconds exists 
These times are somewhat adjustable by means -. the manual control. Thus the 
upper output pulse repetition rate is ii red to about 1200 to 1500 pulses per 
second, 

The pulse .nreshold input, as indicated, is of two types, being additive 
for some elementary components and subtractive for others, The additive thr sh- 


old elementary components cause the output potenti: level of the È unit to 


78 
increase us the average input pulse repetition rate at the threshold inp. 
increases, whereas, in the subtractive threshold elementary componenis, .... 
output potential level of the Z unit decreases as the average input pulse 
repetition rate at the threshold input increase: These two conditions 
correspond somewhat to positive and negative feeuback and so they seem to be 
desirable for a general automaton since either may be desired under --.tain 
operating conditions, 

The general functional operation is similar to the ideal situation 
depicted in Figure 9 of the previous chapter, 
5.3 Facilitator 

The design of the facilitation component part of the Adaptive Reorganizing 
Automaton presented the greatest challenge of any cor’ onent used in the device, 
What was needed was a variable conductance unit, i.e, a malleable unit, which 
would vary in such a manner as to incicase the ability of information to flow 
over a path between two points when that path was used more than other paths 
anu also a uni which remembered or stored this use information--not the 
information transferred--for an appreciable vime, perhaps hours, This malle- 
able unit is the crux of the self-organizing system because it is the element 
which gives the automaton adaptability in the sense of reaction with its 
environment which changes with previous activity knowledge. The facilitation 
unit correspones somewhat, therefore, to the biological neuron synapse, The 
resulting design is shown functionally in Figure 13 and the electronic diagram 
and the operation are described in Appendix B. 

The output part of the facilitator is the amplifier unit which is a 
variable gain direct coupled amplifier whose gain is con rolled by the storage 


unit tc be described soon. The transfer function of the N unit is: 
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Figure 13. Facilitator Block Diagram 
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WH = -GZ i, when 2... <0 
vij HI Lë 
— DO when Z..>0 (4) 
HI 
whore: 
W.. is the instantareous output potential of the N unit (always 


vij 


a pulse output). 

G is the numerical gain of the N unit and is a function of the total 

number of pulses active for a length of time at the input of the 

facilitator (this will be described later). 

Aaj is the instantaneous input potential of the N unit (always a 

pulse input), 

The storage unit stores information relative to the total number of pulses 

active over a length of time at the input to the facilitator, Essentiaily it 


is a pulse counter which takes its control energy from the pulses which are 


transferred through it so that the transfer function of the M unit is: 


WwW zs kä (5) 


where: 
Wiis is the instantaneous output potential of the M unit (always a 
pulse output. , 
e is a constant for any particular M uit, 
4 jd is the ‘nstantaneous input potential of the M unit (always 
puise input). 


The control unit consists basically of two direct-coupled amplifiers, one 


of waich is a " ase inverter, The output of these two amplifiers is summed to 
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become the output pulse of the I unit, When the output ulse is the result of 
only an input pulse at the (+) facilitation input, the storage unit, M, stores 


a positive charge and the gain, G, of the amplifier unit, N, is increased a 


given amount, A G. When the output pulse is the result of o: ly an input pulse 


at the (-) facilitation inr wt, the storage unit stores a negative charge and 
the gain of the amplifier unit is decreased an amount, A G Thus the transfer 


function of the I unit is. 


W o.=-k ,Z + K 7 (6) 
jj tij E La 
Y Y Wig y Yia 
where: 
Kë? is the instantaneous output potential of the I unit (either 
a positive or 2 negative pulse, ) 
k Pe i are constants of their respective networks. 
y y 
7 is the instantaneous input potential of the (+) facilitation 
+ 
Y ij 


input (usually, but not always, a standard , ise}. 


Zo is the instantaneous input potential of the (-) facilitation 
Y hj 
input (usually but not always, a standard pulse). 


In addition, the control unit indirectly controls the gain, G, of th- N 


H 
unit with the result as shown in Figure 14, The ,iin resulting may then be 


expressed as; 


G=k \ W dt + 2 (exponential decay terms) (7) 
v l Yjj t 


where: 
G is the instantaneous numerical gain of the N unit, 


ky is a constant of the respective network, 
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Figure 14, Gain Function for N Unit 
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| iS an integral taken over the period of time from the immediately 


“t 
preceding instant of zero gain to the present, 


2 means summing of the exponential teims encecuntered sequentialiy in 


time, 


The exponential decay terms are the "leakage" terms and are Simply 


written between jumps in the gain curve as; 


G=Gée cet (8) 


where: 


DG is the instantaneous gain at time, t’ 


t is any time such tha. t <t<t”, 


! ; f 
Li is the time interval over which the expression is true. 


k is the decay time constant of the storage unit and associated circuit, 


w.. =Z.. and W = Z .. as indicated in F* ure 13 
JI ~ vis Yji BSG 


Equations (4), (5), (6) and (7) become the transfer function of the entire 


Upon s2ttin 


facilitator component. That is: 


woo. = Dk (k Z. ç -k,Z, ) when (k Z. -kZ ) <0 
vij BY vi oy’ Was Yong Y Yi 
(9) 
Ww. =0 when (x Z - -kZ 0 
vis Y Vhj Y Yij ~ 
where: 
t-t’ 
E 
G=k (k -Z - k Z, )dt+ZGE 
H VW DI Y ij t 
SE 
t-t’ 


when G'E is chosen properly as indicated in Figure l4, by 


84 
letting EN be the gain G on the immediately preceding jump in the 
gain curve, 

The facilitator circuit has several unique features as described in 
Appendix RB, For example, the storage unit may be changed readily to give an 
extremely wide range of adaptation times from seconds to hours; similarly for 
the decay times, if uther than capacitors are considered--for example, nickel- 
cadmium batteries, 

It should be remembered that only pulses active at the (+) facilitation 
input are amplified and appear at the output of the facilitator with an over- 
all gain ranging from zero to two. Pulses active at the (-) facilitation unit 
are rot amplified, but are used only as control of gain, 

5.4 Autonomous Component 

As described in the chapter on natural biological neurons and data 
obtained therefrom, the neuron or at least groups of neurons can act auton- 
omously--that is, produce an outjut with no input being or sent, Whether this 
fact is actually a by-product of neuron existence or whether it is a necessity 
for neuron activity is not really agreed upon by various authorities. Therefore 
to provide an autonomou. component which could be used if desired, but which 
need not be used at all in the Adaptive Reorganizirg Automaton, a separate and 
distinct component was designed. 

The ideal requirements for an autonomous component would require such a 
unit to produce puises at random with respect to its environment but under 
certain restrictions just e same. At first this statement mey seem contra- 
dictory but an example will clear it up. If the autonomous components were 


continuously in Operation, then the neurons whose inputs were being excited 


by these autonomous components would consider them only as part of their 


ER 
environment which sas always present and so would adapt to them, if only in 
the sense of learning to ignore their pulses which were completely random 

with respect to others, Therefore their purpose would be lost since one of 

the purposes of autonomous comp:-nents is to activate the system when no 

external stimuli are present, Ths any ciutonomous “omponents must be restricted 
in their randomness to operate only during peri’ is of : ormal inactivity in the 
automaton, 

Assuming th-s restriction then, the second require of an autonomous 
component was the randomness of pulse output during its limited operation. 

The best solution to this requirer-nt would seem to be either a noir- source 
or another complete self-organizing system to interact with the Adaptive 
Reorganizing Automaton. 

Since neither of these solutions seemed economically practical, at least 
for the first model automaton, the next best solution was adopted, This is 
the acceptance of periodicity in the autonomous co:.ponent provided this 
periodicity is extremely slow compared to the slowest "normal periodicity” of 
the automaton and also provided that this periodicity can be controlled by 
inputs so as to appear "partly random!" from its output. With these require- 
ments, the autonomous compone.it shown in Figure 15 was designed, 

The pulse unit is basicaily the same type as that used in the elementary 
component, except that i: is autonomous in its unstimulated state, That is, 
the network constants are so chosen that, in the absence of any input pulses 
to the component, an internal zentral potential, Ew increases exponentially 
with time at a very slow rate until it exceeds some threshold value, Ə, at 


Ai 


which time the pulse unit fires-~i.e, it produces ən ou" pulse, The 9- 


duction of the pulse reduces Ea to &@ very low value, By from which it again 
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starts to ineres:e -ponentailly, Thus the | ‘ess ls reveated and a periodic 
pulse output results, the repetition rate bein about 10 pulses per second. 


This function may be written as: 


W = 0 when E <9 
Mats cec xX 
= L when E. > eh for a length of time Dr" 


(10) 
where Eo varies between output pulses :» the following manner: 


t 


Et E 
ð O 


where 
WÉI is the instantaneous output potential of the. unit (always a 
sta.dard pulse). 
Eo is the instantaneous internal controli potential of the E unit. 
e is the threshoid potential of the o unit which determines the 
time of firing 
St” is the minimum length of time reolred for the control potential 
to exceed el to cause firing, 

l E is the supply potential of the internal control potential. 
P. is Ae value of Eo after firing. 
k’ is the time constant of the control pote..tial circuit, 
t is any time between output pulses as measured from the preceding 
pulse, 
To prevent the continuous periodic firing of the — unit, an input is 
provided which i unnected directly to the control potertial, Eo: Therefore, 


this potential can be reauced by pulsing the input with negative going pulses 


at the input and this is what the detector unit does. 
The detector unit is basically a pulse inverter which accepts positive 
going pulses at the inp and transmits negative going pulses at the output, 


Therefore its transfer function is simply: 


Yai = 7 ‘nig SE 


where: 
Mogg is the instantaneous output potential of the H unit (essentially 
a pulse), 
Si is a constant of the circuit. 
hij is tne instantaneous input po.ential to the H unit G pulse of 
varying amplitude), 
e 
Due to the previously mentioned input to the / unt if enough pulses 


of great enough amplitude are active at the component input within a given 


time interval, the internal control potential, Ev can be gept below tke 
threshold value, Q. indefinitely. However, when the pulses at the input are 
inactive for a length of time greater than the norma. period of the autonomous 
component, the outpur unit wila “ire, 

This can be seen from the general transfer function of the autoncmous 
component, obtained by setting Wf = 2) 55? as indicated in Figure 15, and by 


the fact that the input pulses at the “ _ unit are intesrated in the unit, 


Thus E can be expressed gs: 
D 


E = ` Ky Z... + 2 (exponential terms) 12) 


where: 


E is the instantaneous control potential with the input ictis 

ky is a constant of the circuit, 

| is an integral taken over the period of time from the preceding 
output pulse, 

X means summing the exponential terms encountered səquentially in time, 

The exponential terms are simply written. between jumps in the Ea versus 


time curve as; 


where: 
E. is the instantaneous control putential at time, t’. 
t is any time such that t'< t< t” 
t- t’ is the time interval] over which tle expression is true, 


Then the transfer function for the autonomous component as contained 


from Equations (10), (11), (22) and (13) is: 


= D when E <Q 
Wag c= A 
=: when E >09 
A 
where: 
o t-t 
E =- jkk Z ee Sie BE Ee 
c XH nij t c c 
when the last ch is properly inte. „veted as indicated previously. 


Reference to Figure 16 will illus’rate ihe above functi ona: variations 
as we.l as give tne transfer function of the autonomous component, 


The resulving autonomous component can be used at any position in the 
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Figure 16. Autonomous Cemponent Function 
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computer to trigger an Energy Transducer and it can obtain input pulses from 
any or all of many different pulse sources, either by direct connection or 
through facilitators, Therefore, with respect to any one neuron which is 


triggered into firing by an autonomous component, the component will appear 


to be rather random in pulse repciition rate if the autonomous Component inputs 


are properly chosen, 


6. EXPERIMENTAL RESULTS 


6.1 Automator Physical Description 

Before discussing some of the experimental results obtained thus far with 
the Adaptive Reorga: izing Automaton, a short description of the physical com- 
ponents and their placement in the assembled units will be given, Also to be 
discussed is the relative complexity which is possible even with the very 
limited size of the present autc.aton. 

The experimental realization of the various components described in 
Chapter 5 took the form of circuit modules, each module being constructed on 
a 2 inch by 3 inch phenolic terminal board, In certain instances each module 
contains only one functional unit such as the Energy Transducer shown in the 
two views of Figure 17. Shown here are the 12 input and one output wires which 
are connected to pin jacks through the front panel. Also apparent is the poten- 
tiometer used to control the manual threshold from the rear of the panel. Seven 
of these modules are mounted perpendicularly behind a standard rack panel which 
is 3 1/2 inches wide and 19 inches long. four of these racks of Energy Trans- 
ducers are available in the assembled automaton, 

The modules shown in Figure 18 and Figure 19, are respectively the Auton- 
omous Component module and the Facilitator module. Both these modules contain 
two functional units each, The simplicity of the Autonomous Component is quite 
apparent from Figure 18, whereas as shown in Figure 19, the Facilitator is some- 
what more complex, Clearly shown in the Facilitator module are the two minia- 
ture 100 microfarad electrolytic capacitors used as storage elements and the two 
vacuum tubes used to isolate the storage elements. Fourteen Autonomous Component 


modules are mounted perpendicularly behind a standard 3 1/2 inch wide rack panel, 
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Figure 17. 


Figure 18, The Two Sides of the Autonomous Component Module 


Figure 19, The Two Sides of the Facilitator Module 
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only one rack of this type being available in the automaton, There are four 
racks of Facilitators available in the automaton, each rack being 3 1/2 inches 
wide and containing fourteen Facilitator modules mounted perpendicularly behind 
it, 

Thus the automaton contains a total of 28 Energy Transducers, 28 Auton- 
omous Components, and 112 Facilitators, In addition it also contains 30 
indicator tubes to be used as signal monitors and general operation pattern 
detectors, <All operating connections between the various units of the automa- 
ton are made by means of pin jack connectors. These pin jacks are clearly 
visible in the photograph of the automaton shown in Figure 20, Connections 
between the various units may thus he made by means of wires, capacitors, 
resistors, diodes, or any impedance elements desirable, making the possible 
flexibility very great. Also the use of these connectors allows access to 
all the signal terminals for monitoring purposes, 

Figure 21 is a photograph of the rear of the automaton, Tiiis view shows 
the placement nf the various modules in the complete automaton. Referring to 
either Figure 20 or Figure 21, the identification of the various racks in the 
automaton are from top to bottom: 2 Energy Transducer racks, the rack of 
indicator tubes, a Facilitator rack, an Energy Transducer rack, a Facilitator 
rack, the Autonomous Component rack, a Facilitator rack, an Energy Transducer 
rack, and a Facilitator rack, 

6.2 Component Experimental Results 

The functioning of the individual components will now be illustrated with 

the aid of experimental data. For example, Figure 22 is a photograph of 


three pairs of oscilloscope traces of the excitatory input and the resulting 


output pulses of an Energy Transducer, The top pair of traces shows an input 


% a 
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Front View of Adaptive Reorganizing Automaton 


Figure 20, 


Figure 21. 
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Note: Bottom trace of each pair is the imput trace, 


Figure 22. Effects of Various Amplitude Excitatory Input 
Pulses upon an Energy Transducer with Fixed 
Threshold Level, 
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pulse whose amplitude is insufficient to cause an output pulse, The middle 
pair of traces shows an input pulse on the bottom of the pair of traces and an 
occasional output pulse on the top trace of the pair, The fact that only an 
occasional pulse is present is shown by the presence of a base line across the 
entire output pulse, The reiso. Tor the occasional pulse output is the refrac- 


tory time of recovery after an output pulse, This is explained more fully 


later with respect to Figure 23, In the bottom pair of traces of Figure 22, 


tre amplitude of the input pulse shown on the bottom trace is sufficient to 
cause an output pulse at all times, 

Figure 23 presents some of the same data as Figure 22 but with the time 
axıs compressed considerably, From this figure it is apparent how the output 
pulse repetition rate is a fraction of the input pulse repetition rate, Th. 
effect is caused by a combination of the input pulse amplitude with respect 
the threshold value of the Energy Transducer and the input pulse repetition 
rate. This can be explained as follows: Following an output pulse from an 
Energy Transducer, the threshold value returns to its quiescent value exponen- 
tially with time. Therefore, the amplitude and repetition rate of the input 
excitatory pulses will determine the time when the decreasing threshold value 
is just exceeded by an input pulse of sufficient amplitude to trigger the 
Energy Transducer output pulse. Thus the effect is a division of the input 
pulse repetition rate, Figure 23 presents the effect clearly in three pairs of 
oscilloscope traces, the input pulses shown on the bottom trace of each 
respective pair, The change in input pulse amplitude over the three pairs of 
traces is very evident. 

Figure 24 illustrates the summation of two excitatory pulses active at the 


input of an Energy Transducer. The top pair of traces shows two pulses active 


Note: Bottom trace of each pair is the input trace, 


Figure 23, Frequency Division of Input Pulse Repetition Rate 
Due to Different Input Pulse Amplitudes, 


Note: Pəttom trace of each pair is the input trace, 


Figure 24, Summation of Excitatery Input Pulses To Produce an 
Output Pulse from Energy Transducer, 
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at the input, but separated in time such that no output resuits since each 
pulse amplitude is below the threshold value of the Energy Transducer, The 
second pair of traces shows the summation of two pulses such that an output 
pulse results occasionally when the two pulses are added, This effect is the 
same as that described previously in Figure 23. The bottom palr of traces shows 
an output pulse for each summation of input pulses. In this instance the time 
between the arrival of the two pulses is sufficiently smal! so tnat in every 
instance the pulse sunimaticn energy is great enough to produce an output pulse 
every time instead of just vecisionally, 

This time of Summation seems reasorably important, For example, assume a 


Pulse signal traverses the patns shown in Figure 25. 
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Figure 25, Contrcl of Energy Transducer B by Means of Parallel 
Signal Paths of Different Lengths, 

The output of ET-A (Energy Transducer A) excites wwo separate paths which 
evemtually are united at the input to ET-B. Here the input pulse anplitude and 
the ET-B threshold are such that neither pulse by itself will trigger ET-B out- 
put, The delay of a puise in transit through an Energy Transducer is vai iable, 
being a function of the input pulse amplitude relative to the threshold, but in 
general it is from one to four microseconds Thus the summation time of input 
pulses to ET-B determines the difference in the numbers n and m of Energy 


Transducers which can be traversed by a pulse and still cause £T-B to produce 
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an output pulse, The present times are such that this difference can be from 
10 to 20, 

There are two more features of the Energy Transducers which can be experi- 
mentally shown, These are the autonomous nature of the transducers and the 
change in threshold due to pulses active at the pulse threshcld input, The 
forner is shown in Figure 26, The threshold of the 4+) Energy Transducer was 
set to4,0 volts--i,e, a pulse of 4,0 volts amplitude was required to trigger 
th. output or the Ercrgy Transducer--ana then the pulse threshold input was 
excited by standard pulses of varying re »ətition rate, As shown, the result 
wi.s output pulses of varying repetition rate, the output pulses being generally 
uncorrelated with the input pulses, However, there 1s generally a gain in the 
repetition rate of the output pulses compared tc the repetition rate of the 
input pulses, this gain varying from six at an input of 50 pps, to about three 
at an input of 500 pps. Thus it is possible to get a form of pulse repetition 
rate increase by this method of excitation. 

Figure 27 shows the change of threshold value of both a (+) and a (-) 
Energy Transducer due to pulse threshold input activity. It will be seen that 
the threshold value for a (+) Energy Transducer decreases from 8.4 volts tc 
4.8 volts for a puise input change from 0 to 500 pulses per second repetition 
rate, whereas the threshold value for a (-) Energy Transducer increases over 
about the same values for the same change of input pulse repetition rate, Thus 
effects similar to both positive and negative feedback are possible with these 


two types of Energy Transducers, 


For the experimental confirmation of the functioning of the Facilitator, 


refer to Figures 28 and 29. Figure 28 shows the gain of the Facilitator as a 


function of the length of time of activity of the (+) facilitation input and of 
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Figure 27. Threshold Variation of Energy Transducers 
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the input pulse repetition rate, That is, starting the Facılitator at zero gain 
ana continuously exciting the (+) facilitation input with a fixed pulse repeti- 
ticn rate and standard amplitude (6 volts), the gain will vary in the manner 
shown. For example, at an input of 500 pps., the gain does not becore notice- 
ably different from zero until about 60 seconds of activity, after which it 
rises rather rapidly to its saturation value in about 300 seconds, It will be 
ner, zo that the curves all have the same general shape, being only shifted 
horizontally to the right from each other and decreasing in saturation value 
as the input pulse repetition rate decreases, The saturation value is depend - 
ent upon an equilibrium between the input pulse energy and the leakage energy 
between pulses from the storage element, and so as the input repetition rate 
decreases, the saturation gain value decreases, 

With reference to the Facilitator gain decay, Figure 29 shows a chara - 
teristic decay for two different manners of saturation. The top curve was 
obtained by first manually saturating the Facilitator and then allowing i; to 
decay with no further excitation except an occasional test signal pulse, The 
bottom curve was similarly obtained except that initially the saturation ‘as 
obtained by pulse excitation. It is seen that both curves are essential’ y 
the same except for amplitudes, 

6.3 System Experimental Results 

Before considering some of the simple results obtained thus far with the 
present automaton, a little explanation about the possible complexit: :s in 
order. From considerations of the various experimental results of t:: Energy 
Transducer and the Facilitator given in the last section, it is appa ent that 


each of these components is very flexible and may have various functions in a 


circuit, For example, the Energy Transducer can serve aS a logica. or” 
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circuit, a logical "and" circuit, a "summing circuit, a pulse repetition 
rate divider, a pulse repetition rate multiplier, etc., when the parameters-- 
particularly the thresholds--are properly established, When this unit is 
combined with the adaptive unit of the system, the Facilitator, then a truly 
complex and flexible component is pcssible, 

Considering only these components, it is readily apparent that tremendous 
interconnectivity is possible, Figure 30 shows how one Energy Transducer, one 
Autonomous Component, and nine Facilitators are connected to form a combination 
elment which has some of the information digestive capabilities of a biological 


neuron, As shown, there are three E inputs (Excitatory), three I inputs (Inhib- 


itory), three T inputs (Threshold), three C inputs (Continuous Threshold), and 


One Output on each Energy Transducer, Each Facilitator has one (+) facilitation 
input, one (-) facilitation input, and one output, Thus Figure 30 is an 
Elementary Componert which has a total of 21 inputs and one output, If com- 
ponents as shown are considered and only the 18 pulse inputs are used, then 


there are 


possible systems for n Elementary Components, This is a very large number of 
systems for only a small number of components as shown in Table II. It is true 
that within these possible systems there are many functionally redundant con- 
nections and also many connections which do not make a totally connected system, 
but even considering these Possibilities, it is seen that the total number of 
systems which can be studied with even this limited automatoun--the Adaptive 


Reorganizing Automaton--is extremely large. Thus it is fairly obvious that 


no exhaustive treatment of all the systems is possible nor is it the purpose 
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Figure 30, General Elementary Component 


TABLE II 


Number of possible systems containing n or less Elementary Components 


No. of 
lementary No. of 
Components Possible Systems 


.62 (10°) 


21804) ons EISE 


218 (9) 
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218 (100) 


18 4 
218(144) 


here to present such a study, It is only the purpose of thıs section to 
illustrate some systems using some of the components described and which have 
varied functions and adaptivity depending upon the manner of interconnection, 
Table III illustrates some of the various possible sub-systems. The table 
is self-explanatory, each circuit containing a note of explanation beside it. 
Checking through the table, it is seen that various functional systems are 
possible, such as repetition rate filters, amplitude filters, repetition rate 
dividers, coincidence circuits, order detectors, counters, and others, Some 


of these are adaptive, being both time and previous history dependent. It is 
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seen that most of the circuits are easily analysed functionally, but at the 


Same time it is apparent that wren the circuit interconnections become great 


enough and the environment complex enough, then the circuits can only be 


analyzed and predicitively studied by means of this or a Similar automaton, 
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TABLE ITI 


SOME REPRESENTATIVE POTENTIAL CONNECTIVITY CIRCUITS, (The explanation 


of the circuit function is shown at the richt of each individual 


circuit) 7 R 

Symbol for Energy Transducer (ET). 
C is Continuous threshold input (3 Possible), 

Cera ae E is Excitatory input (3 possible), 

Pee I is Inhibitory input (3 possible), 

` € e d T is Pulse Threshold input (3 possible). 
Z Ke 
7 D O is output, 


ke 


in symbol indicates (+) or (-) Energy 


Transducer respectively, 


Symbol for Facilitator (F). f 
WE —>—0 (+) F is positive facilitation input. "e 
(~) F is negative facilitation input, 


O is output, 


Symbol for Autonomous Component (AC). 


I <> 6 I is input. 
O is output. 


Non-adaptive element which is a pulse ampli- 


erase tude filter, With more inputs, it will 


"o 5 

A P serve as a pulse adder with respect to EC 

l time and within limits with respect to 
amplitude, 


Circuit 1 e is an environment which is always a pulse 


source of some type, 
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Same as Circuit 1 with F added making the 
r Circuit adaptive in the sense that e does 
e =~ 
d not trigger ET until e has been active for 
KS Some time and will only continue to trigger 
ET if e is not off longer than the time 


Circuit 2 required for F to decay below a certain 


Value, 


Same as Circuit 2 with (-) F connection added, 
This makes output rep, rate less than e, the 
ratio depending upon the relative influence 
of the (+) F and (-) F inputs upon the gain 
of the facilitator, Also decreases adaptive 
influence of F since it cannot have a gain 
Circuit 3 much greater thar that required to trigger 


ET, 


This circuit adapts to the environment having 
the greatest average rep, rate~-the 2 with 
the greatest average rep, rate, It will 
adapt to i. different e ir the former > 
becomes inoperative for a long enough period 
of time. Thus e's which ace inactive for 


periods of time become un-influential. 


If rep. rate of Su is consideratiy greater 


than that of e, for an adaptive time then 


ET will be triggered by e otherwise ET 


1? 
Circuit 5 does not produce an output. Thus this 


circuit is a relative rep. rate detector. 


Circuit 6 


eS 
N, to < | 


Circuit 7 


Circuit 8 
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This circuit becomes autonomous if rep, rate 
of e is great enough for a time dependent 
upon threshold setting and threshold inte- 
eration time, 

Once it is autonomous the rep, rate of the 
output increases very slowly over several 
minutes until it saturates at about 200 pps. 

If the circuit does not become autonomous, 
then it shows hysteresis with respect to 


input pulse amplitude, 


Same as Circuit 6 with F added, This effec- 
tively increases the time required Lo drive 
the circuit to autonomy ard also increases 


the saturation rep, rate. 


Same as Circuit 7 with (-) F input added, 
This makes it pussible to drive the circuit 
out of autonomy if e, is active long enough 
and with a high enough rep, rate. These are 
both dependent upon the length of time the 


circuit has been autonomcus, 


Sam@ as Circuit 6 but using a !-) ET instead 
of a (+) ET. The result is that the output 
rep, rate is less than that of the input rep, 
rate, the ratio being a function of the input 
freq,, decreasing as the input rep. rate 
increases, This circuit is a form of fre- 


quency compressor. 
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This circuit responds to changes in rep, rate 


of e3 in the following manner: 


e T: KE de„/dt > 9 causes the output rep. rate 
S - ! 
SS to increase temporarily, after a period 
Me 


E of time return 6 to its former output 


rep, rate, 
de,/dt <0 causes output to cease, after 
a period of time returning to its former 


Circuit 10 output rep. rate, 


Same as Circuit 10 bit with (-) ET instead of 
(+) ET. The result is that the changes in 


output rep. rate are exactly opposite to 


zhose of Circuit 10. 


Circuit 11 


— Circuit responds to certain input rep. rates 
{<> below a given value dependent upon the 
| - 
\ S threshold setting, It is essentially a 


as 


low pass filter. 


Circuit 12 


Same as Circuit 12 but with (+) ET instead 


of (-) ET. Response is exactly the opposite 


of Circuit 12, It is essentially a high 


pass filter, 


Circuit does not produce a pulse out when 
>—- pulses of e, are coincident with those of 
el over a range of time, this time being 

dependent upon the threshold setting and 


Circuit 14 pulse amplitude. 


Circuit 16 


Circuit 17 


e 


Circuit 18 


Circuit 19 


118 


Amplitude of output pulses increase as the 
ET is active over a period of time. This 
circuit is basically a form of neuron 


proposed by Eccles, 


Circuit is a band pass filter for certain 


settings of the ET thresholds, 


Similar function as Circuit 8 but can be 
driven out of autonomy more easily than 


can circuit 8. 


Selects which oucput shall we active at 
corresponding e rep rate and excludes 
other output if its corresponding e rep. 
rate is less than the first e rep, rate. 
Will interchange this function after an 
adaptiv2 period of the opposite environment 


condition, 


This circuit shows very adaptive character- 
istics, If both Si and e, are equally 
active then both outputs are active. After 
an adaptive period of e predominantly 
active, the circuit responds predominantly 
to the order of application of environments 
ei then ep. However, it will respond to 
the other order of application momentarily. 
It can also be readapted to the opposite 


condition. This is a form of order detector. 
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This circuit is an order of excitation detector, 
& If e, and e, are simultaneously active with 
the same average rep, rate then botr ET's 
have an output momentarily, the time being 
dependent upon the integration time of the 
(-) ET. If either S or e, is activated 
first for an appreciable time before the 
other then only that co“responding ET is 


Circuit 20 activated momentarily, 


e Të This is a combination of Circuit 13 and 
Circuit 8, Normally ET-l is a high pass 


e i filter, When ET-2 is triggered to autonomy 
k 
2 
t+ 


e. 
3 Circuit 21 by e 


by ez then the low frequency cutoff value 


of ÈT-l increases slowly, It returns to 


normal when ET-2 is driven out of autonomy 


3° 


+ This circuit responds to slow changes in rates 

C of e, as follows: 
de/dt > 0 then output rep, rate increases 
de/dt < 0 then output rep, rate decreases 


or momentarily stops, 


Circuit 22 
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The ET thresholds are set so that three 
simultaneous pulses are required to trigger 
ET-3, two simultaneous pulses are required 
to trigger ET-2, and one pulse is required 
to trigger ET-l. Under these conditions the 
circuit becomes a simultaneous pulse counter 
any e activating ET-1, any two e's producing 
simultaneous pulses activating ET-l and ET-2Z 
and all three e's producing simultaneous 
pulses activating ET-1, ET-2, and E1-3. When 
the e's are always simultaneous pulses, but 
not all active then the circuit becomes 


Circuit 23 simply a counter, 


This circuit functions as an input distribu- 
tion pattern detector, For example, assume 
e3 average “ep, rate considerably greater 


than ei or en. Similarly for e3 with 


respect to e5 and Se: and also the same for 


Se with respect to ez and Se: Under these 


conditions and with the circuit attached 


23 


to Circuit 23 as indicated, the entire 
circuit responds to these particular 
environment e coincidences but not others, 
That is, for example, ey and SA producing 
pulses coincidentally wisl cause the counter 


ée of Circuit 


indication to be 2--i,e, ET-l and ET-2 of 


ar 


(counter circuit) 


Circuit 23 to be trig-sered, Similar pulses 


Ke 


are produced for e, and Ee coincidences and 


7o 


for Ba and Se coincidences, However, other 
environment coincidences of pulses do not 
affect the output similarly, 

This circuit can be reacapted to a different 
input coincidence pattern by changing the 

Circuit 24 ratios of the rep. rates of the input 


environmental e's, 
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This iS a trainable adaptive circuit, ror 
example, set the thresholds as in Circuit 2? 
then perform the following experiment: Use 
the same pulse source for all the e's; that 
is, all the e's when active are in synchro- 


nism, Apply e, until ET-1 triggers, Apply 


1 
ei and e3 Simultaneously until ET~2 triggers 
aso. Apply SÉ ez and e3 simultaneously 


until ET-3, in addition to the other ET s, 
triggers, Then the circuit responds as 
follows: Si active triggers ET-l. e 

or ez active alone gives no output, e and 


l 

e3 active simultaneously triggers ET-l and 
ET-2. Any other combination of two simul- 
taneous inputs will only trigger ET-l but 
not ET-2, All e's active simultaneously 
will trigger all the ET's 

This circuit can be readapted to a different 
response by changing the order of the train- 
ing environment application, 

The above effects are short term effects 


Circuit 25 with the present automaton. 
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This circuit exhibits a gradually expanding 
wave of activity progressing from ET-1l 
through the ET's sequentially until ET-n 
becomes active, How far through this 
sequence the wave progresses is dependent 
upon the length of time e is active at the 
input, The individual ET's remain active 
after this initial transient which is very 
Slow, until the input e ceases activity or 
becomes low in rep, rate, Then a similar 
wave progresses through the system, but in 


this instance the ET's become inactive 


Circuit 26 sequentially along the connected system, 


123 


liis circuit exhibits autonomous action of 
more than just a simple type. For example, 
exciting it for a period of time with e will 
start a wave of activity through it similar 
to that in Circuit 26. If the eis then 
removed for a time, the activity will continue 
in a manner such that the waves start and stop 
in somewhat of a non-repetitive fashion, 
gradually ceasing after a long period of 
activity, During this period the circuit is 
fairly sensitive to various stimuli, some 
causing greater activity and some causing 
less activity, In fact, e, which originally 


excited the circuit to activity, will 


occasionally stop the activity completely, 
This is one of the types of activity which 


will be studied with the present automaton, 


Circuit 27 


The above circuits are only indicative of some of the various 
Systems which can be studied with the present autcmaton and are to be 
consicered as only an extremelv small sample of the total possible 


systems, 


7. CONCLUSIONS 


Experimental tests on components which have been developed to have 
functional behavior similar to biological neurons indicate that interesting 
adaptive behavior may indeed be possible with circuits composed of these 
components. For example, the initial test on the automaton which has been 
constructed from these components have shown that adaptive pattern recognizers, 
order detectors, and even circuits having certain autonomous pattern behavior 
are possible. These basic processes of adaptation are presently of only the 
most elementary type, but with greater environmental complexity, which involves 
more elaborate input transducers, it is felt that much greater adaptive func- 
tional behavior is possible. 

Certain unpredicted effects with the automaton may be of more than passing S 
interest. For example, when the automaton is operated with only portions of 
it actively connected into a system, those portions which are unconnected 
signal-wise but interdependent energy-wise, occasionally produce pulses in 
synchronism with each other and with the autonomous components, This is 
explainable in the automaton by incomplete filtering and by the individual 
Energy Transducer threshold settings. However, it has a correspondence in the 
biological system where the alpha rhythm is present in the inactive cortex, 

In short, a form of "biological computer" is now available which is 
extremely flexibie in its operation possibilities. Two methods of use of this 
automaton are open to the operator. The first method is that similar tc the 
operation of an analogue computer in which the complete system connectivity 
is specified and the resulting details of operation are monitored when different 


prescribed environments are active, The second method is that similar to the 


interaction between a biologist and a living system in which various potential 
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connectivities between the components are made rather randomly, and then the 
effects of varicus environments upon the functional connectivities are studied. 
This latter method is by far the most interesting and is the manner in which 
the automaton was meant to be used, Using this method, knowledge of various 


Systems will be gained and catalogued so that more complex connective systems 


Can be constructed, 
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APPENDIX A 


ENERGY TRANSDUCER 


Tre Energy Transducer is composed basically of two functionally different 
circuit units. As shown in Figure 31, the section to the right of the vertical 
dashed line is the pulse source and standardization unit whereas the section to 
the left of the dashed line has the function of controlling the source and 
standardization unit, In connection with the letter section, Figure 32 differs 
from Figure 31 only in the pulse threshold input part of the control unit as 
will be explained later, At Present, then, either figure may be considered, 

The pulse source and standardization unit is basically a monostable cirt ait 
which is triggered by pulses arriving from the pulse control unit. The active 
element of this monostable circuit is the composite transistor unit shown 
enclosed in dashed lines, This composite transistor consists of a CK722 and 
a 2N35 transistor connected together in a 'hook-connected’ transistor fashion. 
When connected in this manner and treated as a single transistor with the 


terminals e, b, and c corresponding to the emitter, base. and collector. the 
a Hi H , ` ` 


composite transistor unit has characteristics similar to a point contact 


transistor, In particular, it has ana > 1 over certain ranges of operation 
and So will exhibit a region of negative resistance. It is this property which 
is useful in the present connection. 

The quiescent condition of the composit? transistor unit and the associated 
circuit is such that tie c terminal is at ground potential, the b terminal is 
at + 6.0 volts potential, and the e terminal is at some potential less than 
+ 6.0 volts, When the potential of the e terminal is raised above the potential 


of the b terminal, by means of a pulse of great enough magnitude arriving from 
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the pulse control unit, the CK722 transistor conducts Current, If the energy 
content of this current source is high enough to drive the CK722 into its 
saturated conduction region--and this will be true Only above certain charge 
levels of the 5K micro-microfarad capacitor, C, connected between terminals 
e and c-~then the composite transistor operating pcint is forced into the high 
current, low voltage region of its characteristic, This results in a rapid 
discharge of the above-mentioned Capacitor, C, After discharge, the current 
source impedance increases to the point where the composite transistor cannot 
be held in its high conduction region and it returns to its former condition 
with the e terminal potential less than the b terminal potential, In this 
condition the capacitor, C, charges to its former quiescent condition over a 
period of time depending upon the charging current path resistance, 

Simultaneously, with the discharge of the capacitor, C, and the high con- 
duction condition of the composite transistor, it will be noticed that the 
potential difference between the terminals b and c is very small, Since the 
potential of the b terminal is fixed at + 6.0 volts, this means that tue poten- 
tial of the c terminal is raised to very nearly + 6.0 volts for the period of 
composite transistor high conductance, after which the potential of the c x 
terminal returns to near ground, The result is a pulse of an amplitude of 
nearly 6 volts from a source whose output impedance is low--only a few tens of 
ohms, 

Immediately following the pulse, the capacitor, C, is charged to its 
quiescent potential condition over a period of time depending upon the equiva- 
lent RC time constant of the circuit, This recovery time is about one to two 


milliseconds, At the very beginning of this recovery time, and for about one- 


fourth of the total time, the charge on the capacitor, C, is so low that it >. 
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cannot Support the composite transistor unit in the region of negative conduct- 
ance, Therefore, during this time the pulse source unit canrot produce any 
pulses regardless if it is triggered or not, This is the period of absolute 
refractory time, Following this period is the period of relative refractory 
time during which the pulse source unit can only be excited by pulses of 
increased amplitude, After complete recovery, the pulse source can be triggered 
normally. 

The pulse control unit of the energy transducer consists of three pulse 
input sections each with a different purpose; a constant level input called 
the continuous threshold input; and a manual threshold control. These different 
sections will now be explained, 

The excitatory inputs consist of a summing network composed of the three 
5K micro-microfarad capacitors and the 22K ohm resistors in the base circuit of 
a 2N35 transistor, The output of this network thus controls the 2N35 transistor 


amplifier output so that a positive pulse appears at the e terminal of the com- 


posite transistor previously described whenever a pulse, or pulse summation, of 


amplitude greater than 3.0 volts is present at the excitatory input. Depending 
upon the amplitude of the input pulses and upon the setting of the threshold 
level to be described later, the pulse source may be triggered and an output 
pulse may result. The summing network was arbitrarily chosen such that the 
summation is nonlinear; that is, the effect of two pulses of a given amplitude 
is not the same «s that of a single pulse of twice the given amplitude, Also 
the time of summation of pulses was rather arbitrarily set at about 50 micro- 
seconds, 

The inhibitory inputs are identical t> the excitatory inputs except that 


a negative pulse appears at the e terminal of the composite transistor for 
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pulses active at the input, The gain of the inhibitory amplifier is also such 
that identicai simultaneous pulses at both the excitatory and inhibitory inputs 
will not cause an output pulse, That is, the inhibition imput has more gain 
than the excitatory input. The result is essentially a pulse-by-pulse inhibition. 
The pulse threshold inputs are identical to the excitatory inputs through 
the first stage of amplification, After that, the circuits differ; in particu- 
lar the pulses active at the pulse threshold inputs are integrated by the 106 M 
micro-microfarad capacitor, The result is a slowly varying voltage whose ampli- 
tude is a function of the input pulses. This voltage is then used to control a 
transistor, either a CK722 or a 2N35 as shown in Figure 31 and Figure 32 respec- 
tively. In Figure 31 this varying voltage causes the threshold potential of the 
e terminal to increase as the pulses active at the pulse threshold inputs 
increase in amplitude or in average repetition rate or both and the pulse 
source then becomes more sensitive to excitatory pulses--that is, the threshold 
of the energy transducer decreases, In Figure 32 the effect of the pulses at 


the pulse threshold inputs have the opposite effect as those in Figure 31. 


With respect to the time constant of integration of the pulse threshold inputs, 


it is many times that of the other pulse inputs, being a few seconds in value, 

The continuous threshold input is merely a direct control of the threshold 
potential by any source of potential, either other energy transducers or 
external sources, Sinilarly, the manual threshold allows a direct control of 
the threshold by external means. 

There is one elesent remaining to be explained in the energy transducer and 
that is the 1N35 diode across the output terminals. Its purpose is to clamp the 
output potential at ground with respect to any negative pulses appearing at the 
output because such pulses tend to trigger the pulse source unit if the thresh- 


old is at a low value and at present this may be undesireable, 


APPENDIX B 


FACILITATOR 


The Facilitator circuit shown in Figure 33 is whoily dependent upon the 
storage unit labeled S in the diagram and so an explanation of this unit seems 
to be in order, To provide a storage unit of any type, some physical state or 
states must be changed in a manner which is controllable and which is detect- 
able, To be useful, the state must be established at the beginning of the 
storage time and, at some time later, this state must be measured witk enough 
reliability to correlate the input datum with the output-~chat is, remembered-- 
datum, There are many methods of storing data in use at present, but most of 
these systems are too eleborate and expensive to be considered as a sub-unit 
of any general elementary component--i.e. artificial neuron. Required for 
this purpose is a unit which is inexpensive, reasonably reliable for storage 
times of several minutes or perhaps tens of minutes, and whose associated input 
and output circuitry is reasonably simple, 


AS a result, several simple storage units were considered and experimented 


upon, among them being the position of a potentiometer tap, the electrolytic 


deposition of metals, the decompositon of an electrolyte into its constituent 

gases, simple charge storage on a capacitor, ete, Of these, be capacitor gave 

the most promising simple soiution and so is the scheme presently being used, 
However, for greater storage times and consequently more reliability, the 

S unit in Figure 33 m y also be a completely discharged nickel-cadmium battery 

of extremely small size, This battery stores charge on its plates in a manner 

Similar to an electrolytic capacitor but with an apparently much greater leakage 


resistance, Thus the time-constant of the battery is several times that of an 
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electrolytic capacitor with tae result that long storage times are easily 
obtained, 

For example, when the circuit of Figure 33 ıs used with a 200 micro- 
farad, 3 volt electrolytic capacitor as the § unit, a storage time of 6 to 10 
minutes can be obtained if the initial redistribution of charge on the plates 
and in the electrolyte are ignored. When the § unit is a 100 milliampere- 
hour nickel-cadmium battery, which is much smaller in physical size than the 
capacitor, a storage time of several hours can he obtained, 

The Facilitator itself is basically a direct coupled two stage amplifier 
whose gain is dependent upon the total number of pulses which have been active 
at the (+) facilitation and the (-) facilitation inputs combined, The pulses 
which are active at the (+) facilitation input increase the facilitation and 
are reproduced at the output as pulses with increasing amplitude, The pulses 
which are active at the (-) facilitation input are effective only in decreas- 
ing the facilitation and are not reproduced at the output. Thus both positive 
and negative facilitation is available with only the positive facilitation 
data pulses being transferred to the output, In addition to pulse facili- 
tation, manual facilitation is also possible, For example, grounding the 
manual facilitation terminal will give maximum facilitation and raising the 
manual facilitation terminal to + 13,5 volts will give minimum facilitation 
instantaneously. Any facilitation level may thus be obtained by the manual 
facilitation terminal, 

The detailed operation of the Facilitator can be most easily understood 
if the transfer of a pulse from the input to the output is traced. Assume 


that the S unit has charge stored in it of such an amount that the voltage 


across it is one volt with the grid terminal positive. Also assume that a 
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pulse of + 6 volt amplitude is impressed on the (+) facilitation input, The 
corresponding 2N35 transistor is driven into saturation conduction with the 
result that the potential of the negative terminal of the S unit is reduced 
to approximately + 6 volts. Thus the cathode of the 6AL5 diode is reduced in 
potential to about + 7 volts and the diode is driven into conduction, The 
result is a depletion of electrons from the grid terminal of the S unit and 
an increase in the voltage across the S unit. When the S unit has zero 
voltage across it, the circuit potentials are such that the bias of the 
12AX7 triode is near cutoff, As the voltage across the S unit increases, 
the 12AX7 triode grid potential is raised above cutoff and the triode con- 
ducts current between pulses. Therefore when the S unit voltage is one volt, 
the triode is biased above cutoff and is conducting currert between pulses, 
When the grid terminal is reduced in potential by the (+) facilitation input 
pulse, the grid of the triode is driven far below cutoff and a positive 
pulse appears at the output, the magnitude of which is dependent upon the 
voltage across the S unit. 

Negative facilitation occurs when a + 6 volt pulse is impressed on the 
(-) facilitation input, This results in the corresponding 2N35 transistor 
conducting in saturation with a resulting increase in potential of the 
negative terminal of the S unit to about + 15 volts, The grid of the 12AX7 
triode is thus driven above zero bias and grid current results. Therefore 
electrons are deposited on the grid terminal of the S unit and the S unit 
voltage is decreased, Ordinarily, driving the grid more positive would 


result in a negative output pulse. To prevent ihis the 2N35 transistor 


emitter follower in the output stage is biased at ground potential, 


139 

The facilitation circuit has several unique features, For example, for 
isolaticn of one end of the § unit electrically, vacuum tubes were required, 
This in turn makes it possible for the S unit to be interrogated by pulses 
of amplitudes up to + 3 volts without changing the S unit voltage. Also the 
gain of the (-) facilitation is such that it is about 5 to 10 times more 
effective in reducing the facilitation level for a given input pulse than is 
the (+) facilitation in increasing the facilitation level for the same pulse 
except when these pulses are simultaneously active at both inputs, Then the 
(-) facilitation gain is only slightly greater than the (+) facilitation gain. 
This allows the output of an Energy Transducer to control the level of facili- 


tation of any Facilitator directly connected to its input, 


APPENDIX C 


AUTONOMOUS COMPONENT 


The Autcenomous Component shown in Figure 34 is Simply a relaxation oscil- 
lator whose repetition rate can be controiled by selectively discharging the 
capacitive element, That is, the oscillator is a 1 M ohm iesistor in series 
with a 100 K micro-microfarad capacitor. The active elenent is a composite 
transistor identical to that used in the Energy Transducer described in 
Appendix A. This produces a pulse in precisely the same manner as the pulse 
source in the Energy Transducer, However, in the Autonomous Component, capac- 
itor, C, receives energy from a + 12 volt source and thus the potenriiali of 
the emitter of the CK722 transistor can become greater than the + 6 volt 
potential at its base, Therefore the circuit is normally autonomous, producing 
a pulse output of repetition rate of about 10 pulses per second, 

To prevent the Autonomous Component from producing an output when the input 
pulse repetition rate is above about 10 pulses per second, a 2N25 transistor 
is connected directly across Capacitor, C. The input pulses are active on the 
base of this transistor, each pulse whose amplitude is greater than + 1.5 volts 
causing an emitter current in the transistor, Each time the ransistor is 
thus activated, the collector potential decreases and the Capacitor, C, is 
drained of some of its energy. If this process occurs often enough--as it 


does when the input pulses are + 6 volts in amplitude and have a repetition 


rate greater than 10 pps--then the potential of the CK722 emitter is kept below 


+ 6 volts an? no output pulse occurs. 
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Figure 34, Autonomous Component 


